-- Logs begin at Fri 2022-08-26 00:02:07 UTC, end at Fri 2022-08-26 01:26:29 UTC. -- Aug 26 00:48:49.837040 dv-osbrick-853500-2-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 26 00:48:49.849473 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 26 00:48:49.849473 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 00:48:49 2022] *** Aug 26 00:48:49.849473 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 00:48:49.849473 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 00:48:49.849473 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: nodename: dv-osbrick-853500-2-ceph Aug 26 00:48:49.849473 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: machine: x86_64 Aug 26 00:48:49.849473 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: clock source: unix Aug 26 00:48:49.849473 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: pcre jit disabled Aug 26 00:48:49.849473 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: detected number of CPU cores: 4 Aug 26 00:48:49.849473 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: current working directory: / Aug 26 00:48:49.849473 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: detected binary path: /usr/bin/uwsgi-core Aug 26 00:48:49.849473 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: your processes number limit is 47680 Aug 26 00:48:49.849473 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: your memory page size is 4096 bytes Aug 26 00:48:49.849473 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: detected max file descriptor number: 2048 Aug 26 00:48:49.849473 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: lock engine: pthread robust mutexes Aug 26 00:48:49.853189 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: thunder lock: enabled Aug 26 00:48:49.853189 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 26 00:48:49.853189 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 00:48:49.896080 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: Python main interpreter initialized at 0x55fda6bc89c0 Aug 26 00:48:49.896080 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: python threads support enabled Aug 26 00:48:49.896080 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: your server socket listen backlog is limited to 100 connections Aug 26 00:48:49.896080 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: your mercy for graceful operations on workers is 90 seconds Aug 26 00:48:49.896583 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 00:48:49.896736 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: *** Operational MODE: preforking *** Aug 26 00:48:49.897086 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: *** uWSGI is running in multiple interpreter mode *** Aug 26 00:48:49.897086 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: spawned uWSGI master process (pid: 88498) Aug 26 00:48:49.899136 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: spawned uWSGI worker 1 (pid: 88530, cores: 1) Aug 26 00:48:49.897296 dv-osbrick-853500-2-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 26 00:48:49.899338 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: spawned uWSGI worker 2 (pid: 88531, cores: 1) Aug 26 00:48:49.899410 dv-osbrick-853500-2-ceph devstack@keystone.service[88498]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 00:48:54.655462 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:48:54.655462 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: from cryptography.utils import int_from_bytes Aug 26 00:48:54.656282 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:48:54.656282 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: from cryptography.utils import int_from_bytes Aug 26 00:48:54.657708 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:48:54.657708 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: from cryptography.utils import int_from_bytes Aug 26 00:48:54.658220 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:48:54.658220 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: from cryptography.utils import int_from_bytes Aug 26 00:48:54.711731 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 00:48:54.711933 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 00:48:54.712030 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 00:48:54.712120 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 00:48:54.712200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] command line args: [] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 00:48:54.712276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] command line args: [] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 00:48:54.712352 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 00:48:54.712432 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 00:48:54.712509 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ================================================================================ {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 00:48:54.712581 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ================================================================================ {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 00:48:54.712757 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] admin_token = **** {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.712845 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] admin_token = **** {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.713004 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] config_dir = [] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.713101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] config_dir = [] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.713178 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.713255 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.713359 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] config_source = [] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.713435 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] config_source = [] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.713539 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] debug = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.713630 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] debug = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.713738 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.713995 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.714089 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.714157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.714306 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.714391 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.714518 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.714603 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.714945 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.715051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.715051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] list_limit = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.715170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] list_limit = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.715233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] log_config_append = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.715296 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] log_config_append = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.715353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.715419 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.715608 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] log_dir = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.715696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] log_dir = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.715757 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] log_file = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.715813 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] log_file = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.715933 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.716008 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.716169 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.716262 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.716415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.716492 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.716664 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.716748 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.716825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.716902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.717027 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.717108 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.717239 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.717324 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.717485 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.717568 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.717720 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.717850 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.717978 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.718087 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.718205 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.718332 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.718481 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.718607 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.718728 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.718893 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.719018 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.719139 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.719253 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.719418 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.719751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.121/identity {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.719873 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.121/identity {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.719980 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] publish_errors = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.720081 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] publish_errors = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.720182 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.720282 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.720377 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.720481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.720579 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.720686 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.720805 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.720940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.721065 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.721186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.721307 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] standard_threads = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.721421 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] standard_threads = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.721540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.721663 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.721773 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.721886 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.721988 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.722600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.722703 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] use_journal = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.722922 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] use_journal = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.723048 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] use_json = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.723164 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] use_json = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.723267 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] use_stderr = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.723379 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] use_stderr = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.723502 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] use_syslog = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.723628 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] use_syslog = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.723755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.723871 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:48:54.723983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.724102 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.724217 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.724341 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.724462 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.724583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.724703 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.724819 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.724938 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.725044 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.725158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.725277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.725397 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.725512 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.725630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.725755 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.725878 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.725998 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.726118 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.726238 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.726358 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.726483 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.726604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.726725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.726866 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.726993 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.727108 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.727237 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.727377 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.727515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.727636 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.727752 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.727871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.727999 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.728120 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.728240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.728344 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.728464 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.728584 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.728770 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.728897 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.729019 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.729133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.729252 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.729367 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.729488 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.729608 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.729722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.729840 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.729962 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.730086 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.730200 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.730313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.730426 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.730538 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.730683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.730807 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.730949 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.731072 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.731187 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.731300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.731418 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.731541 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.731656 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.731775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.731889 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.732001 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.732115 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.732239 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.732239 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.732455 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.732455 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.732707 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.732707 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.732929 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.733050 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.733176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.733291 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.733413 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.733528 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.733652 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.733768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.733894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.734009 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.734122 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.734245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.734360 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.734494 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.734616 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.734736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.734898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.735025 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.735025 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.735250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.735373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.735495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.735610 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.735730 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.735845 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.735970 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.736085 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.736205 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.736329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.736444 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.736557 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.736679 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.736795 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.736909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.737022 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.737135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.737249 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.737375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.737491 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.737611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.738281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.738410 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.738527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.738651 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.738799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.739330 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.739557 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.739762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.739879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.740013 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.740139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.740256 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.740370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.740485 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.740608 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.740724 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.740845 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.740962 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.741076 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.741190 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.741304 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.741489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.741608 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.741723 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.741836 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.741950 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.742063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.742185 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.742300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.742414 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.742534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.742659 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.742782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.742932 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.743051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.743182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.743298 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.743413 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.743526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.743642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.743761 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.743888 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.744012 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.744127 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.744241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.744355 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.744469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.744582 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.744681 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.744776 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.744871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.744965 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.745060 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.745164 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.745261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.745365 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.745461 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.745562 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.745664 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.745769 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.745877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.745975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.746070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.746164 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.746265 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.746368 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.746470 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.746567 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.746669 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.746772 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.746997 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.750657 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.750765 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.750907 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.750983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.751110 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.751188 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.751267 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.751345 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.751416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.751485 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.751554 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.751631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.751702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.751771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.751840 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.751908 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.751977 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.752054 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.752125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.752195 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.752264 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.752345 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.752417 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.752493 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.752564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.752632 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.752701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.752770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] auth.external = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.752865 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.752945 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.753024 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.753103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.753181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] auth.external = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.753262 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.753341 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.753417 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] auth.password = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.753417 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] auth.token = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.753553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.753626 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.753695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.753695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] auth.password = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.753821 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.753890 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] auth.token = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.753973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.753973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.754101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.754171 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.754240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.754309 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.754385 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.754457 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.754526 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.754595 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] credential.caching = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.754664 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.754733 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.754809 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.754903 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.754973 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.755042 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.755112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] credential.caching = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.755181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.755262 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.755336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.755411 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.755483 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.755552 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.755621 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.755766 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.755840 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.755917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.755988 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.756064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.756134 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.756257 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.756339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.756406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.756466 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.756587 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.756664 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.756744 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.756816 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.756886 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.756956 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.757025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.757095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] federation.caching = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.757172 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.757251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.757328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.757400 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.757470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.757540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.757617 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] federation.caching = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.757690 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.757760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.757830 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.757906 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.757983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.758066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.758144 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.758216 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.758286 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.758356 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.758425 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.758503 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.758575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.758644 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.758714 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.758894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.758990 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity.caching = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.759065 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.759143 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.759216 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.759286 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.759357 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.759434 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.759512 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity.caching = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.759584 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.759654 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.759723 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.759792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.759870 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.759942 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.760013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.760120 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.760202 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.760372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.760463 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.760605 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.760684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.760840 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.760919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.761073 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.761160 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.761321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.761401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.761623 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.761756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.761885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.762021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.762160 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.762318 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.762318 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.762552 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.762552 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.762801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.762953 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.763035 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.763035 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.763317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.763454 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.763591 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.763719 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.763845 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.763972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.764097 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.764224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.764363 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.764490 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.764618 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.764745 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.764870 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.765003 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.765138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.765266 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.765392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.765530 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.765653 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.765776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.765906 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.766030 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.766152 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.766275 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.766397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.766527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.766659 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.766794 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.766940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.767076 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.767198 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.767321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.767457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.767604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.767733 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.767917 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.768043 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.768175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.768265 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.768329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.768329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.768433 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.768491 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.768642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.768775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.768916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.769044 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.769166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.769312 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.769433 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.769568 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.769695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.769838 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.769838 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.770121 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.770264 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.770405 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.770551 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.770630 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.770788 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.770889 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.770975 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.771071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.771191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.771265 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.771336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.771406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.771485 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.771600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.771600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.771737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.771808 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.771877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.771956 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.772029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.772145 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.772224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.772379 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.772456 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.772614 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.772694 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.772851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.772932 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.773086 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.773165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.773344 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.773443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.773589 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.773669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.773838 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.773924 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.774076 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.774155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.774315 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.774394 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.774545 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.774623 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.774794 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.774896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.775058 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.775138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.775297 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.775376 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.776603 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.776719 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.776838 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.776962 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.777078 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.777194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.777381 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.777504 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.777620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.777735 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.777851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.777966 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.778089 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.778205 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.778325 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.778440 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.778555 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.778670 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.778798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.778938 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.779053 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.779169 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.779285 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.779400 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.779528 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.779645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.779760 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.779875 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.779990 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.780105 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.780228 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] resource.caching = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.780345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.780461 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.780576 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.780691 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.780806 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.780935 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.781052 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.781167 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.781282 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.781398 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.781513 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.781636 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.781753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] resource.caching = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.781873 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.781989 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.782104 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.782219 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.782343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.782460 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.782576 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] role.caching = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.782690 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.782811 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] role.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.782991 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.783120 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.783237 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.783353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.783353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.783353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.783672 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.783795 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.783912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.784028 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.784133 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.784133 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] role.caching = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.784366 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.784366 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.785134 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] role.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.785134 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.785389 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.785389 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.785618 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.785735 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.785735 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.785951 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.786065 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.786180 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.786302 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.786418 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.786418 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.786635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.786750 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.786881 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.786881 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.787115 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.787230 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.787345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.787345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.787567 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.787567 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.787794 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.787908 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.788023 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.788143 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.788257 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.788381 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.788498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.788612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.788728 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.788843 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.788957 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.789079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.789195 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.789310 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.789424 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.789538 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.789661 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.789778 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.789893 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.790007 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.790122 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.790236 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.790236 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.790461 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.790576 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.790690 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.790805 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] token.caching = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.790978 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.791106 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.791223 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.791337 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.791451 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.791566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.791680 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.791803 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.791921 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.792036 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.792150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.792265 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.792380 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.792502 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.792618 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.792732 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.792847 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.792962 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.793061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.793181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.793297 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] token.caching = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.793412 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.793527 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.793642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.793762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.793886 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.794004 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.794004 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.794219 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.794334 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.794447 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.794574 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.794698 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.794839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.794958 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.795075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.795189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.connection = **** {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.795304 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.795430 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.795548 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.795669 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.795784 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.795899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.796014 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.796138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.796260 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.796444 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.796558 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.796655 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.796752 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.796861 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.796861 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.797130 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.797229 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.797325 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.797420 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.797515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.connection = **** {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.797610 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.797713 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.797817 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.797919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.798016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.798113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.798209 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.798313 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.798411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.798507 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.798601 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.798697 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.798792 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.798965 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.799066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.799066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 00:48:54.799244 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.799244 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.799429 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.799640 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.799879 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.800154 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.800943 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.801194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.801428 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.801742 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.801956 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:48:54.802161 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 00:48:54.829018 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.829243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.829470 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.831570 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.831807 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.832035 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.838085 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.841676 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.870014 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.870239 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.870842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.871093 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.939582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.939769 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.988526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.988776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.989719 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:54.989955 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.057009 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.057230 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.057318 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.057456 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.057560 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.057677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.057761 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.057894 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.057976 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.058109 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.058208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.058332 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.088205 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.088435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.088528 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.088665 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.088772 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.088892 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.088976 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.089111 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.089194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.089326 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.089411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.089538 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.089621 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.089748 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.101488 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.101756 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.119217 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.119426 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.119517 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.119658 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.119762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.119882 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.120015 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.120093 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.120166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.120304 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.120388 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.120518 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.120598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88530) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.120733 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88531) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:48:55.137406 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.137610 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:48:55.137956 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.138089 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.138177 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:48:55.138307 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:48:55.138411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.138653 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.138738 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.138879 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:48:55.138966 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.139161 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.139245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.139429 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.139695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.139956 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.149256 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.149540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.149813 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.150075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.150160 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.150360 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.150634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.150947 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.157166 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.157987 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.160728 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.162986 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.162986 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.163205 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.163286 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.163361 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.163474 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.163572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.163651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.163776 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.163854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.163974 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.164109 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.164196 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.164269 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.164342 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.164414 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.164414 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.164608 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.164608 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.164608 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.164608 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.186076 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.187240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.187583 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.187869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.188719 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.189011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.192479 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.192712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.193599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.193890 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.194286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.194672 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.200719 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.201001 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.201490 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.201777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.205262 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.205554 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.205801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.205893 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.206103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.206947 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.207341 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.207621 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.207932 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.208200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.208288 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.208476 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.208669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.208824 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.209150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.209394 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.224702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.224984 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.228885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.229445 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.229736 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.231995 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.232409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.233661 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.236735 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.236835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.237232 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.239955 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.241604 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.243059 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.243360 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.243647 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.244037 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.244345 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.244638 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.244786 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.247923 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.248227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.248531 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.248930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.249223 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.254611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.260826 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.261114 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.261392 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.261653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.265361 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.265678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.265915 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.266183 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.268463 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.270655 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.270960 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.273621 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.273720 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.273902 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.274195 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.274480 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.274758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.275343 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.275617 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.278308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.278594 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.280460 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.280460 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.280460 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.286684 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.287002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.287288 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.287571 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.287855 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.288145 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.288424 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.291402 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.291692 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.291978 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.292278 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.292570 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.292863 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.293140 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.303892 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.307351 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.308644 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.310329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.311640 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.311911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.313393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.313677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.313958 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.314656 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.316157 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.317655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.317949 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.318245 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.320527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.322009 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.324826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.324917 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.325186 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.325492 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.325773 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.326573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.329509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.329916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.330206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.330501 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.334544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.334832 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.335119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.339752 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.340045 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.340328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.343319 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88530) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.344685 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.344975 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.345259 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.345535 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.345813 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.346111 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.346395 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.346669 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.347538 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.347679 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88531) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:48:55.347837 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.348071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.348179 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.348363 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.348512 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.348650 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.348740 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88530) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.348936 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.349221 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.349500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.349782 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.350065 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.350349 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.350626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.350922 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.351201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.351466 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88531) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:48:55.382192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fda6bc89c0 pid: 88530 (default app) Aug 26 00:48:55.385771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02459f-1485-4f0a-bbe6-2e91d05f2127 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:55.386059 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02459f-1485-4f0a-bbe6-2e91d05f2127 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:55.386148 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fda6bc89c0 pid: 88531 (default app) Aug 26 00:48:55.386334 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02459f-1485-4f0a-bbe6-2e91d05f2127 None None] PATH_INFO: `/v3` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:55.390543 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 1/1] 10.222.0.121 () {50 vars in 796 bytes} [Fri Aug 26 00:48:55 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:04.007130 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3f432-ea34-4bc7-bdcb-421ac0bf256f None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:04.007637 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3f432-ea34-4bc7-bdcb-421ac0bf256f None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:04.007718 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3f432-ea34-4bc7-bdcb-421ac0bf256f None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:04.011925 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 1/2] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:04 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:49:04.017358 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8063c-f19a-46a5-bf13-3e53ba639e9b None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:04.017778 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8063c-f19a-46a5-bf13-3e53ba639e9b None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:04.017904 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8063c-f19a-46a5-bf13-3e53ba639e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:04.094685 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: INFO dbcounter [None req-aaf8063c-f19a-46a5-bf13-3e53ba639e9b None None] Registered counter for database keystone Aug 26 00:49:04.116536 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG oslo_db.sqlalchemy.engines [None req-aaf8063c-f19a-46a5-bf13-3e53ba639e9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:49:04.122771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writer thread running {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:49:04.303710 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG passlib.handlers.bcrypt [None req-aaf8063c-f19a-46a5-bf13-3e53ba639e9b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88530) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 00:49:04.304216 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG passlib.handlers.bcrypt [None req-aaf8063c-f19a-46a5-bf13-3e53ba639e9b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88530) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 00:49:04.359505 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-aaf8063c-f19a-46a5-bf13-3e53ba639e9b None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:04.361097 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-aaf8063c-f19a-46a5-bf13-3e53ba639e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:04.492460 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 2/3] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:04 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 26 00:49:05.011102 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3f432-ea34-4bc7-bdcb-421ac0bf256f None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:05.087940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: INFO dbcounter [None req-cef3f432-ea34-4bc7-bdcb-421ac0bf256f None None] Registered counter for database keystone Aug 26 00:49:05.108340 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG oslo_db.sqlalchemy.engines [None req-cef3f432-ea34-4bc7-bdcb-421ac0bf256f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:49:05.114945 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writer thread running {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:49:05.237525 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3f432-ea34-4bc7-bdcb-421ac0bf256f None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:05.241869 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f2a03-97a1-4ab6-a341-9f9ca8517389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:05.242490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f2a03-97a1-4ab6-a341-9f9ca8517389 admin admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:05.242769 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f2a03-97a1-4ab6-a341-9f9ca8517389 admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:05.243066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f2a03-97a1-4ab6-a341-9f9ca8517389 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:05.251222 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f2a03-97a1-4ab6-a341-9f9ca8517389 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:05.304582 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: WARNING keystone.common.rbac_enforcer.enforcer [None req-560f2a03-97a1-4ab6-a341-9f9ca8517389 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 00:49:05.304582 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f2a03-97a1-4ab6-a341-9f9ca8517389 admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:05.315534 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 2/4] 10.222.0.121 () {58 vars in 1329 bytes} [Fri Aug 26 00:49:05 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:49:05.321606 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8063c-f19a-46a5-bf13-3e53ba639e9b None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:05.339781 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8063c-f19a-46a5-bf13-3e53ba639e9b None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:05.344500 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5db06-4fcf-45f1-b7c7-d9f73636fb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:05.345631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5db06-4fcf-45f1-b7c7-d9f73636fb45 admin admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:05.345914 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5db06-4fcf-45f1-b7c7-d9f73636fb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:05.346214 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5db06-4fcf-45f1-b7c7-d9f73636fb45 admin admin] PATH_INFO: `/v3/projects/e4454f1e3bf94358ad484413a3205af0` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:05.350126 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5db06-4fcf-45f1-b7c7-d9f73636fb45 admin admin] RBAC: Authorizing `identity:get_project(project_id=e4454f1e3bf94358ad484413a3205af0)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:05.402558 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f1c5db06-4fcf-45f1-b7c7-d9f73636fb45 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 00:49:05.402923 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5db06-4fcf-45f1-b7c7-d9f73636fb45 admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:05.407553 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 3/5] 10.222.0.121 () {56 vars in 1212 bytes} [Fri Aug 26 00:49:05 2022] GET /identity/v3/projects/e4454f1e3bf94358ad484413a3205af0 => generated 345 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:07.579441 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5976bc2-f534-4d48-8fa4-7d4b8b5be78b None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:07.579952 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5976bc2-f534-4d48-8fa4-7d4b8b5be78b None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:07.580040 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5976bc2-f534-4d48-8fa4-7d4b8b5be78b None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:07.584715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 3/6] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:07 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:07.590324 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32727fa-76c8-4b71-bc6f-eff31b24d20b None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:07.590726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32727fa-76c8-4b71-bc6f-eff31b24d20b None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:07.590909 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32727fa-76c8-4b71-bc6f-eff31b24d20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:07.610972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-b32727fa-76c8-4b71-bc6f-eff31b24d20b None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:07.612520 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-b32727fa-76c8-4b71-bc6f-eff31b24d20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:07.620702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 4/7] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:07 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 26 00:49:07.947691 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5976bc2-f534-4d48-8fa4-7d4b8b5be78b None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:07.960971 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5976bc2-f534-4d48-8fa4-7d4b8b5be78b None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:07.965329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f8b20-4175-4b70-b7b0-dc0316f3c682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:07.965922 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f8b20-4175-4b70-b7b0-dc0316f3c682 admin admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:07.966205 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f8b20-4175-4b70-b7b0-dc0316f3c682 admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:07.966480 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f8b20-4175-4b70-b7b0-dc0316f3c682 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:07.975213 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f8b20-4175-4b70-b7b0-dc0316f3c682 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:07.977005 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f8b20-4175-4b70-b7b0-dc0316f3c682 admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:07.985917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 4/8] 10.222.0.121 () {58 vars in 1329 bytes} [Fri Aug 26 00:49:07 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:49:07.991887 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32727fa-76c8-4b71-bc6f-eff31b24d20b None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:08.001459 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32727fa-76c8-4b71-bc6f-eff31b24d20b None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:08.005927 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98dfa3-6bff-45e2-94c2-1aaca909cc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:08.006559 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98dfa3-6bff-45e2-94c2-1aaca909cc84 admin admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:08.006876 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98dfa3-6bff-45e2-94c2-1aaca909cc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:08.007161 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98dfa3-6bff-45e2-94c2-1aaca909cc84 admin admin] PATH_INFO: `/v3/users/5579ecb3986c47e1b18c2e33e293c21b` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:08.008559 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98dfa3-6bff-45e2-94c2-1aaca909cc84 admin admin] RBAC: Authorizing `identity:get_user(user_id=5579ecb3986c47e1b18c2e33e293c21b)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:08.010506 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98dfa3-6bff-45e2-94c2-1aaca909cc84 admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:08.012106 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 5/9] 10.222.0.121 () {56 vars in 1203 bytes} [Fri Aug 26 00:49:07 2022] GET /identity/v3/users/5579ecb3986c47e1b18c2e33e293c21b => generated 248 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:10.318809 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711252fc-6963-40c5-ad62-fb662d408623 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:10.319328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711252fc-6963-40c5-ad62-fb662d408623 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:10.319407 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711252fc-6963-40c5-ad62-fb662d408623 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:10.320720 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 5/10] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:10.326448 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c144f45-64d5-43d6-b008-22ce68bf7403 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:10.326913 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c144f45-64d5-43d6-b008-22ce68bf7403 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:10.327058 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c144f45-64d5-43d6-b008-22ce68bf7403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:10.347127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-2c144f45-64d5-43d6-b008-22ce68bf7403 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:10.348414 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-2c144f45-64d5-43d6-b008-22ce68bf7403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:10.442310 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 6/11] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:49:10.508153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2535b-c4ff-4def-bdbc-05e9dccd946d None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:10.508996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2535b-c4ff-4def-bdbc-05e9dccd946d None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:10.508996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2535b-c4ff-4def-bdbc-05e9dccd946d None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:10.510657 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 6/12] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:10 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:10.516345 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fbe48-a898-4741-9046-3562bf617c68 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:10.516637 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fbe48-a898-4741-9046-3562bf617c68 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:10.517813 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fbe48-a898-4741-9046-3562bf617c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:10.649383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-6b4fbe48-a898-4741-9046-3562bf617c68 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:10.650326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-6b4fbe48-a898-4741-9046-3562bf617c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:10.668786 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:10.732223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 7/13] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:10.815865 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2535b-c4ff-4def-bdbc-05e9dccd946d None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:10.960132 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2535b-c4ff-4def-bdbc-05e9dccd946d None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:10.993593 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33d76c-da30-4173-aa8f-521b800bc836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:10.994447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33d76c-da30-4173-aa8f-521b800bc836 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:10.994739 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33d76c-da30-4173-aa8f-521b800bc836 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:10.995053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33d76c-da30-4173-aa8f-521b800bc836 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:11.006268 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33d76c-da30-4173-aa8f-521b800bc836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-af33d76c-da30-4173-aa8f-521b800bc836 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:11.016842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:11.018241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:11.019206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:11.019206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:11.019206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:11.019206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:11.019206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:11.019206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:11.019206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:11.019206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:11.019206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:11.019206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:11.019206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:11.019206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:11.019206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 7/14] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:49:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:11.024627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fbe48-a898-4741-9046-3562bf617c68 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:11.062806 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33d76c-da30-4173-aa8f-521b800bc836 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:11.098732 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:11.141930 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fbe48-a898-4741-9046-3562bf617c68 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:11.174718 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33d76c-da30-4173-aa8f-521b800bc836 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:11.177479 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333280d-0085-4d75-873c-e05f7b7b6648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:11.178104 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333280d-0085-4d75-873c-e05f7b7b6648 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:11.178385 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333280d-0085-4d75-873c-e05f7b7b6648 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:11.178662 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333280d-0085-4d75-873c-e05f7b7b6648 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:11.179599 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333280d-0085-4d75-873c-e05f7b7b6648 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:11.179723 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333280d-0085-4d75-873c-e05f7b7b6648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:11.181075 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333280d-0085-4d75-873c-e05f7b7b6648 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:11.193476 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 8/15] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:11 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:11.199345 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333280d-0085-4d75-873c-e05f7b7b6648 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:11.212020 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59171bd2-7cb2-4da7-b4be-37ee7b0abcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:11.212889 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59171bd2-7cb2-4da7-b4be-37ee7b0abcf8 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:11.213175 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59171bd2-7cb2-4da7-b4be-37ee7b0abcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:11.213460 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59171bd2-7cb2-4da7-b4be-37ee7b0abcf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:11.215872 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:11.283210 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59171bd2-7cb2-4da7-b4be-37ee7b0abcf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:11.284713 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59171bd2-7cb2-4da7-b4be-37ee7b0abcf8 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:11.300489 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333280d-0085-4d75-873c-e05f7b7b6648 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:11.318081 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:11.336410 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d9e41-2745-405e-a8e0-d0ed1d697d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:11.337175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d9e41-2745-405e-a8e0-d0ed1d697d5c None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:11.337451 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d9e41-2745-405e-a8e0-d0ed1d697d5c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:11.337727 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d9e41-2745-405e-a8e0-d0ed1d697d5c None admin] PATH_INFO: `/v3/users/5579ecb3986c47e1b18c2e33e293c21b` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:11.338900 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d9e41-2745-405e-a8e0-d0ed1d697d5c None admin] RBAC: Authorizing `identity:get_user(user_id=5579ecb3986c47e1b18c2e33e293c21b)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:11.340525 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d9e41-2745-405e-a8e0-d0ed1d697d5c None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:11.342185 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 9/16] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:11 2022] GET /identity/v3/users/5579ecb3986c47e1b18c2e33e293c21b => generated 248 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:11.347660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d9e41-2745-405e-a8e0-d0ed1d697d5c None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:11.385738 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 8/17] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:11 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:49:11.391653 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59171bd2-7cb2-4da7-b4be-37ee7b0abcf8 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:11.434759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:11.456259 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d9e41-2745-405e-a8e0-d0ed1d697d5c None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:11.495012 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f322da-178c-4b66-919e-6fd0f183df03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:11.495568 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f322da-178c-4b66-919e-6fd0f183df03 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:11.495848 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f322da-178c-4b66-919e-6fd0f183df03 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:11.496112 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f322da-178c-4b66-919e-6fd0f183df03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:11.497263 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f322da-178c-4b66-919e-6fd0f183df03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:11.498734 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f322da-178c-4b66-919e-6fd0f183df03 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:11.500709 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 10/18] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:49:11 2022] GET /identity/v3/domains/default => generated 200 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:11.507287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f322da-178c-4b66-919e-6fd0f183df03 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:11.509191 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59171bd2-7cb2-4da7-b4be-37ee7b0abcf8 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:11.546353 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7ce20-1d41-4d5c-81f2-9dbbc3b2ad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:11.547025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7ce20-1d41-4d5c-81f2-9dbbc3b2ad22 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:11.547304 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7ce20-1d41-4d5c-81f2-9dbbc3b2ad22 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:11.547572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7ce20-1d41-4d5c-81f2-9dbbc3b2ad22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:11.550386 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:11.568231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7ce20-1d41-4d5c-81f2-9dbbc3b2ad22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:11.569704 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7ce20-1d41-4d5c-81f2-9dbbc3b2ad22 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-69e7ce20-1d41-4d5c-81f2-9dbbc3b2ad22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:49:11.586151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:11.587384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:49:11.588474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:49:11.588474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:49:11.588474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:11.590969 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 9/19] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:49:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:49:11.593195 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7ce20-1d41-4d5c-81f2-9dbbc3b2ad22 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:11.613976 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f322da-178c-4b66-919e-6fd0f183df03 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:11.649824 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766dcf59-cb49-4def-ab5b-5617f61923d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:11.650441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dcf59-cb49-4def-ab5b-5617f61923d8 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:11.650721 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dcf59-cb49-4def-ab5b-5617f61923d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:11.651072 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dcf59-cb49-4def-ab5b-5617f61923d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:11.651791 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766dcf59-cb49-4def-ab5b-5617f61923d8 None admin] RBAC: Adding query filter params (role.id=e73a8fc0684c4f6083a71ea9a85c7298, scope.domain.id=default, user.id=5579ecb3986c47e1b18c2e33e293c21b) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:11.652078 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766dcf59-cb49-4def-ab5b-5617f61923d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:11.653547 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766dcf59-cb49-4def-ab5b-5617f61923d8 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:11.660333 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 11/20] 10.222.0.121 () {56 vars in 1327 bytes} [Fri Aug 26 00:49:11 2022] GET /identity/v3/role_assignments?user.id=5579ecb3986c47e1b18c2e33e293c21b&scope.domain.id=default&role.id=e73a8fc0684c4f6083a71ea9a85c7298 => generated 234 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:11.706317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7ce20-1d41-4d5c-81f2-9dbbc3b2ad22 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:11.746970 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d556a17-4c24-4927-9bfa-ce715b581688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:11.747536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d556a17-4c24-4927-9bfa-ce715b581688 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:11.747798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d556a17-4c24-4927-9bfa-ce715b581688 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:11.748072 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d556a17-4c24-4927-9bfa-ce715b581688 None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:11.748753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d556a17-4c24-4927-9bfa-ce715b581688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:11.749062 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d556a17-4c24-4927-9bfa-ce715b581688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:11.750517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d556a17-4c24-4927-9bfa-ce715b581688 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:11.887509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 10/21] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:49:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:14.320131 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac660-87f6-40db-950b-06daf7e11f06 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:14.320626 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac660-87f6-40db-950b-06daf7e11f06 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:14.320696 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac660-87f6-40db-950b-06daf7e11f06 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:14.322283 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 12/22] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:14.328209 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c1bd9-cd02-4947-b9b8-66fae30b36b2 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:14.329098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c1bd9-cd02-4947-b9b8-66fae30b36b2 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:14.329610 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c1bd9-cd02-4947-b9b8-66fae30b36b2 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:14.331201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 11/23] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:14.332673 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe51bbe-2a76-4302-97d3-f7e767f93401 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:14.333165 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe51bbe-2a76-4302-97d3-f7e767f93401 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:14.333648 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe51bbe-2a76-4302-97d3-f7e767f93401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:14.349383 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed6599-f657-4b4a-a9d8-4d98c8957f27 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:14.349985 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed6599-f657-4b4a-a9d8-4d98c8957f27 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:14.350455 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed6599-f657-4b4a-a9d8-4d98c8957f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:14.373117 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-ebe51bbe-2a76-4302-97d3-f7e767f93401 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:14.374889 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-ebe51bbe-2a76-4302-97d3-f7e767f93401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:14.376290 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG passlib.handlers.bcrypt [None req-d3ed6599-f657-4b4a-a9d8-4d98c8957f27 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88531) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 00:49:14.376932 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG passlib.handlers.bcrypt [None req-d3ed6599-f657-4b4a-a9d8-4d98c8957f27 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88531) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 00:49:14.399172 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:14.468408 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-d3ed6599-f657-4b4a-a9d8-4d98c8957f27 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:14.470156 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-d3ed6599-f657-4b4a-a9d8-4d98c8957f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:14.533361 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 13/24] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:14.571749 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:14.604455 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 12/25] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 26 00:49:14.932354 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04bf19-26c2-452a-b5a2-33f0c5e697da None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:14.933015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04bf19-26c2-452a-b5a2-33f0c5e697da None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:14.933533 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04bf19-26c2-452a-b5a2-33f0c5e697da None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:14.935381 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 14/26] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:14.941212 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2c012-6f4d-4352-8e25-bcebcf0807ec None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:14.941746 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2c012-6f4d-4352-8e25-bcebcf0807ec None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:14.942209 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2c012-6f4d-4352-8e25-bcebcf0807ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:14.966944 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-bdb2c012-6f4d-4352-8e25-bcebcf0807ec None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:14.968706 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-bdb2c012-6f4d-4352-8e25-bcebcf0807ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:15.056115 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 13/27] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:15.086297 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04bf19-26c2-452a-b5a2-33f0c5e697da None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:15.216139 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d851911-f9aa-4864-870e-59a2df886c2b None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:15.216847 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d851911-f9aa-4864-870e-59a2df886c2b None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:15.217336 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d851911-f9aa-4864-870e-59a2df886c2b None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:15.219141 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 14/28] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:15.228520 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04bf19-26c2-452a-b5a2-33f0c5e697da None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:15.232456 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324c676-cd85-42c6-8c4e-10bd17beedc3 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:15.232964 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324c676-cd85-42c6-8c4e-10bd17beedc3 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:15.233455 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324c676-cd85-42c6-8c4e-10bd17beedc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:15.268841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-5324c676-cd85-42c6-8c4e-10bd17beedc3 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:15.270891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-5324c676-cd85-42c6-8c4e-10bd17beedc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:15.317760 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac87e7-2df5-4f9c-ab67-382a3ddb6c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:15.318416 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac87e7-2df5-4f9c-ab67-382a3ddb6c47 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:15.318695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac87e7-2df5-4f9c-ab67-382a3ddb6c47 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:15.318992 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac87e7-2df5-4f9c-ab67-382a3ddb6c47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:15.339508 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac87e7-2df5-4f9c-ab67-382a3ddb6c47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:15.341018 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac87e7-2df5-4f9c-ab67-382a3ddb6c47 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:15.359171 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-bdac87e7-2df5-4f9c-ab67-382a3ddb6c47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:49:15.377321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:15.378197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:49:15.379003 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:49:15.379003 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:49:15.379003 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:49:15.379153 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 15/29] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:49:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:15.379976 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac87e7-2df5-4f9c-ab67-382a3ddb6c47 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:15.417369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 15/30] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:15 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:15.417973 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324c676-cd85-42c6-8c4e-10bd17beedc3 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:15.495082 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:15.535913 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac87e7-2df5-4f9c-ab67-382a3ddb6c47 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:15.603082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4c37b-d61b-417d-93cb-a9ffed235a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:15.605199 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4c37b-d61b-417d-93cb-a9ffed235a7c None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:15.606074 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4c37b-d61b-417d-93cb-a9ffed235a7c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:15.607504 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4c37b-d61b-417d-93cb-a9ffed235a7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:15.622758 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324c676-cd85-42c6-8c4e-10bd17beedc3 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:15.635552 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4c37b-d61b-417d-93cb-a9ffed235a7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-e7e4c37b-d61b-417d-93cb-a9ffed235a7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:15.641667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:15.642534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:15.643300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:15.643300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:15.643300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:15.643300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:15.643300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:15.643300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:15.643300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:15.643300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:15.643300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:15.643300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:15.643300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:15.643300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:49:15.643300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 16/31] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:49:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:15.643911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4c37b-d61b-417d-93cb-a9ffed235a7c None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:15.706651 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde13019-276e-46d1-9716-54a108ba0561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:15.707297 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde13019-276e-46d1-9716-54a108ba0561 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:15.707574 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde13019-276e-46d1-9716-54a108ba0561 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:15.707844 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde13019-276e-46d1-9716-54a108ba0561 None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:15.708492 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde13019-276e-46d1-9716-54a108ba0561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:15.708790 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde13019-276e-46d1-9716-54a108ba0561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:15.710228 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde13019-276e-46d1-9716-54a108ba0561 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:15.737724 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 16/32] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:49:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:15.738371 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde13019-276e-46d1-9716-54a108ba0561 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:15.760860 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:15.844879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4c37b-d61b-417d-93cb-a9ffed235a7c None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:15.888930 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d16962-cd0e-46df-bcc3-d825073fed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:15.889419 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d16962-cd0e-46df-bcc3-d825073fed82 None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:15.889703 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d16962-cd0e-46df-bcc3-d825073fed82 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:15.889979 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d16962-cd0e-46df-bcc3-d825073fed82 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:15.890668 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d16962-cd0e-46df-bcc3-d825073fed82 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:15.892226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d16962-cd0e-46df-bcc3-d825073fed82 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:15.910673 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:15.916908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde13019-276e-46d1-9716-54a108ba0561 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:15.952145 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad61945-b9cf-4534-b837-3011ba8c832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:15.952768 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad61945-b9cf-4534-b837-3011ba8c832f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:15.953050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad61945-b9cf-4534-b837-3011ba8c832f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:15.953327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad61945-b9cf-4534-b837-3011ba8c832f None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:15.954050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad61945-b9cf-4534-b837-3011ba8c832f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:15.954360 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad61945-b9cf-4534-b837-3011ba8c832f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:15.955813 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad61945-b9cf-4534-b837-3011ba8c832f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:15.973735 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 17/33] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:15 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:15.973735 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad61945-b9cf-4534-b837-3011ba8c832f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:16.076238 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad61945-b9cf-4534-b837-3011ba8c832f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:16.109833 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cc8fc-573c-4850-b4d3-1d0941d1365b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:16.110442 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cc8fc-573c-4850-b4d3-1d0941d1365b None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:16.110748 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cc8fc-573c-4850-b4d3-1d0941d1365b None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:16.111051 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cc8fc-573c-4850-b4d3-1d0941d1365b None admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:16.111905 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cc8fc-573c-4850-b4d3-1d0941d1365b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:16.113356 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cc8fc-573c-4850-b4d3-1d0941d1365b None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:16.248800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 17/34] 10.222.0.121 () {60 vars in 1136 bytes} [Fri Aug 26 00:49:15 2022] POST /identity/v3/roles => generated 220 bytes in 605 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:49:16.249738 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d16962-cd0e-46df-bcc3-d825073fed82 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:16.400366 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d16962-cd0e-46df-bcc3-d825073fed82 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:16.420377 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:16.442504 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e354ba-6be6-4441-9bb0-748d78364b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:16.443264 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e354ba-6be6-4441-9bb0-748d78364b32 None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:16.443684 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e354ba-6be6-4441-9bb0-748d78364b32 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:16.444032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e354ba-6be6-4441-9bb0-748d78364b32 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:16.444998 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e354ba-6be6-4441-9bb0-748d78364b32 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:16.447056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e354ba-6be6-4441-9bb0-748d78364b32 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:16.511495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 18/35] 10.222.0.121 () {60 vars in 1146 bytes} [Fri Aug 26 00:49:15 2022] POST /identity/v3/projects => generated 302 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:49:16.512498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cc8fc-573c-4850-b4d3-1d0941d1365b None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:16.527367 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:16.623425 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cc8fc-573c-4850-b4d3-1d0941d1365b None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:16.625501 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 18/36] 10.222.0.121 () {60 vars in 1136 bytes} [Fri Aug 26 00:49:16 2022] POST /identity/v3/roles => generated 226 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:49:16.627722 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca9fb0-3c2b-4e60-b9ac-2005e295dea0 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:16.628078 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca9fb0-3c2b-4e60-b9ac-2005e295dea0 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:16.628423 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca9fb0-3c2b-4e60-b9ac-2005e295dea0 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:16.630051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 19/37] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:16.631884 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe202bd-460f-4071-868b-6b20bcbd49b6 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:16.631884 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe202bd-460f-4071-868b-6b20bcbd49b6 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:16.631884 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe202bd-460f-4071-868b-6b20bcbd49b6 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:16.633213 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 20/38] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:16.640354 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d92f-363f-42e0-ad9c-a48d1a9642b0 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:16.640794 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d92f-363f-42e0-ad9c-a48d1a9642b0 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:16.641222 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d92f-363f-42e0-ad9c-a48d1a9642b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:16.670584 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-26a8d92f-363f-42e0-ad9c-a48d1a9642b0 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:16.672458 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-26a8d92f-363f-42e0-ad9c-a48d1a9642b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:16.673890 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795a5ad-e1e6-4f8e-a4f9-5582d78989b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:16.674791 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795a5ad-e1e6-4f8e-a4f9-5582d78989b9 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:16.675302 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795a5ad-e1e6-4f8e-a4f9-5582d78989b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:16.675589 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795a5ad-e1e6-4f8e-a4f9-5582d78989b9 None admin] PATH_INFO: `/v3/users/5579ecb3986c47e1b18c2e33e293c21b` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:16.677341 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795a5ad-e1e6-4f8e-a4f9-5582d78989b9 None admin] RBAC: Authorizing `identity:get_user(user_id=5579ecb3986c47e1b18c2e33e293c21b)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:16.679043 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795a5ad-e1e6-4f8e-a4f9-5582d78989b9 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:16.680827 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 19/39] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:16 2022] GET /identity/v3/users/5579ecb3986c47e1b18c2e33e293c21b => generated 248 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:16.687206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3da3c-455b-474b-a40f-852d01ec32de None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:16.687509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3da3c-455b-474b-a40f-852d01ec32de None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:16.687779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3da3c-455b-474b-a40f-852d01ec32de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:16.711535 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-e3f3da3c-455b-474b-a40f-852d01ec32de None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:16.713829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-e3f3da3c-455b-474b-a40f-852d01ec32de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:16.783468 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 21/40] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:16.784711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8d92f-363f-42e0-ad9c-a48d1a9642b0 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:16.809870 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 20/41] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:16.911649 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8d92f-363f-42e0-ad9c-a48d1a9642b0 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:16.920541 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:16.950020 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abc00d-967e-469d-b26f-7e27544b4ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:16.950661 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abc00d-967e-469d-b26f-7e27544b4ba1 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:16.951000 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abc00d-967e-469d-b26f-7e27544b4ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:16.951279 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abc00d-967e-469d-b26f-7e27544b4ba1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:16.952442 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abc00d-967e-469d-b26f-7e27544b4ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:16.953911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abc00d-967e-469d-b26f-7e27544b4ba1 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:16.955779 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 22/42] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:49:16 2022] GET /identity/v3/domains/default => generated 200 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:16.962319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3da3c-455b-474b-a40f-852d01ec32de None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:16.973722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:17.066069 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3da3c-455b-474b-a40f-852d01ec32de None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:17.101595 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7d043-42fb-41f2-b336-1ae9117b0e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:17.102263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7d043-42fb-41f2-b336-1ae9117b0e58 None admin] REQUEST_METHOD: `PUT` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:17.102263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7d043-42fb-41f2-b336-1ae9117b0e58 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:17.103043 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7d043-42fb-41f2-b336-1ae9117b0e58 None admin] PATH_INFO: `/v3/domains/default/users/5579ecb3986c47e1b18c2e33e293c21b/roles/e73a8fc0684c4f6083a71ea9a85c7298` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:17.104875 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7d043-42fb-41f2-b336-1ae9117b0e58 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5579ecb3986c47e1b18c2e33e293c21b, role_id=e73a8fc0684c4f6083a71ea9a85c7298)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:17.106327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7d043-42fb-41f2-b336-1ae9117b0e58 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:17.141426 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abc00d-967e-469d-b26f-7e27544b4ba1 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:17.226596 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 21/43] 10.222.0.121 () {58 vars in 1366 bytes} [Fri Aug 26 00:49:16 2022] PUT /identity/v3/domains/default/users/5579ecb3986c47e1b18c2e33e293c21b/roles/e73a8fc0684c4f6083a71ea9a85c7298 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:49:17.227468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7d043-42fb-41f2-b336-1ae9117b0e58 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:17.245004 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abc00d-967e-469d-b26f-7e27544b4ba1 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:17.285305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34186ee2-aa76-4cb1-b065-176311172aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:17.285959 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34186ee2-aa76-4cb1-b065-176311172aa4 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:17.286241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34186ee2-aa76-4cb1-b065-176311172aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:17.286513 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34186ee2-aa76-4cb1-b065-176311172aa4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:17.287804 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34186ee2-aa76-4cb1-b065-176311172aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:17.289324 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34186ee2-aa76-4cb1-b065-176311172aa4 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:17.292830 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 23/44] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:49:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:17.297321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34186ee2-aa76-4cb1-b065-176311172aa4 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:17.322680 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:17.350805 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:17.363128 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7d043-42fb-41f2-b336-1ae9117b0e58 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:17.402904 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf081b9-ff01-462e-95ed-1480689f7180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:17.404258 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf081b9-ff01-462e-95ed-1480689f7180 None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:17.404672 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf081b9-ff01-462e-95ed-1480689f7180 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:17.405351 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf081b9-ff01-462e-95ed-1480689f7180 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:17.406191 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf081b9-ff01-462e-95ed-1480689f7180 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:17.408445 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf081b9-ff01-462e-95ed-1480689f7180 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:17.418069 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34186ee2-aa76-4cb1-b065-176311172aa4 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:17.453716 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7090d3-4279-43e2-a6c5-2979f1feccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:17.454392 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7090d3-4279-43e2-a6c5-2979f1feccbd None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:17.454656 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7090d3-4279-43e2-a6c5-2979f1feccbd None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:17.454965 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7090d3-4279-43e2-a6c5-2979f1feccbd None admin] PATH_INFO: `/v3/projects` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:17.455620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7090d3-4279-43e2-a6c5-2979f1feccbd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:17.457781 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7090d3-4279-43e2-a6c5-2979f1feccbd None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:17.527650 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 22/45] 10.222.0.121 () {60 vars in 1136 bytes} [Fri Aug 26 00:49:17 2022] POST /identity/v3/roles => generated 224 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:49:17.617864 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 24/46] 10.222.0.121 () {60 vars in 1146 bytes} [Fri Aug 26 00:49:17 2022] POST /identity/v3/projects => generated 313 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:49:19.432129 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af9c51-0160-4efc-bcfc-04683d42ef69 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:19.432649 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af9c51-0160-4efc-bcfc-04683d42ef69 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:19.432732 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af9c51-0160-4efc-bcfc-04683d42ef69 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:19.434232 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 23/47] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:19.440582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a4737-ff4b-4dce-bd0c-dbf4735f00d9 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:19.441025 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a4737-ff4b-4dce-bd0c-dbf4735f00d9 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:19.441148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a4737-ff4b-4dce-bd0c-dbf4735f00d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:19.462416 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-081a4737-ff4b-4dce-bd0c-dbf4735f00d9 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:19.463712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-081a4737-ff4b-4dce-bd0c-dbf4735f00d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:19.542530 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 25/48] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:19.870081 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af9c51-0160-4efc-bcfc-04683d42ef69 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:19.977396 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af9c51-0160-4efc-bcfc-04683d42ef69 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:20.006287 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:20.011813 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8739da-e887-4b18-a463-1b63c57cf8d0 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:20.012105 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8739da-e887-4b18-a463-1b63c57cf8d0 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:20.012387 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8739da-e887-4b18-a463-1b63c57cf8d0 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:20.013723 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 26/49] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:20.014340 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa1fb8-4ff2-4557-8311-b44607416228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:20.015081 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa1fb8-4ff2-4557-8311-b44607416228 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:20.015369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa1fb8-4ff2-4557-8311-b44607416228 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:20.015650 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa1fb8-4ff2-4557-8311-b44607416228 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:20.021794 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82322d54-a66d-4078-948b-f58970d9b951 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:20.021794 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82322d54-a66d-4078-948b-f58970d9b951 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:20.021794 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82322d54-a66d-4078-948b-f58970d9b951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:20.027670 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa1fb8-4ff2-4557-8311-b44607416228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-fdaa1fb8-4ff2-4557-8311-b44607416228 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:20.032505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:20.033629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:20.034384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:20.034384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:20.034384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:20.034384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:20.034384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:20.034384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:20.034384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:20.034384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:20.034384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:20.034384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:20.034384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:20.034384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:20.034384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 24/50] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:49:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:20.037855 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-82322d54-a66d-4078-948b-f58970d9b951 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:20.039344 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-82322d54-a66d-4078-948b-f58970d9b951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:20.039447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa1fb8-4ff2-4557-8311-b44607416228 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:20.058610 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:20.111399 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 27/51] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:49:20.154003 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa1fb8-4ff2-4557-8311-b44607416228 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:20.196299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74839dc-287c-4890-a110-f837b8980247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:20.197190 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74839dc-287c-4890-a110-f837b8980247 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:20.197612 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74839dc-287c-4890-a110-f837b8980247 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:20.198026 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74839dc-287c-4890-a110-f837b8980247 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:20.199338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74839dc-287c-4890-a110-f837b8980247 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:20.199804 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74839dc-287c-4890-a110-f837b8980247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:20.201983 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74839dc-287c-4890-a110-f837b8980247 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:20.213413 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 25/52] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:20 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:20.221138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82322d54-a66d-4078-948b-f58970d9b951 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:20.324158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82322d54-a66d-4078-948b-f58970d9b951 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:20.358650 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695f143-5cd8-4022-982e-143031709400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:20.359316 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695f143-5cd8-4022-982e-143031709400 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:20.359602 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695f143-5cd8-4022-982e-143031709400 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:20.359879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695f143-5cd8-4022-982e-143031709400 None admin] PATH_INFO: `/v3/users/5579ecb3986c47e1b18c2e33e293c21b` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:20.361640 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695f143-5cd8-4022-982e-143031709400 None admin] RBAC: Authorizing `identity:get_user(user_id=5579ecb3986c47e1b18c2e33e293c21b)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:20.363329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695f143-5cd8-4022-982e-143031709400 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:20.365110 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 28/53] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:20 2022] GET /identity/v3/users/5579ecb3986c47e1b18c2e33e293c21b => generated 248 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:20.370564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74839dc-287c-4890-a110-f837b8980247 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:20.421058 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:20.443118 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695f143-5cd8-4022-982e-143031709400 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:20.467659 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:20.474050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74839dc-287c-4890-a110-f837b8980247 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:20.513125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c4f9f-b19f-45b4-963b-26f4486c0cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:20.513763 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c4f9f-b19f-45b4-963b-26f4486c0cc4 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:20.514093 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c4f9f-b19f-45b4-963b-26f4486c0cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:20.514373 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c4f9f-b19f-45b4-963b-26f4486c0cc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:20.515530 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c4f9f-b19f-45b4-963b-26f4486c0cc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:20.517541 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c4f9f-b19f-45b4-963b-26f4486c0cc4 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:20.519152 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 26/54] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:49:20 2022] GET /identity/v3/domains/default => generated 200 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:20.525295 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c4f9f-b19f-45b4-963b-26f4486c0cc4 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:20.556685 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695f143-5cd8-4022-982e-143031709400 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:20.593779 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f775b-f1a7-4b71-b8f2-c354af671e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:20.594551 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f775b-f1a7-4b71-b8f2-c354af671e0e None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:20.595414 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f775b-f1a7-4b71-b8f2-c354af671e0e None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:20.595694 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f775b-f1a7-4b71-b8f2-c354af671e0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:20.596830 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f775b-f1a7-4b71-b8f2-c354af671e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:20.598307 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f775b-f1a7-4b71-b8f2-c354af671e0e None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:20.599982 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 29/55] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:49:20 2022] GET /identity/v3/domains/default => generated 200 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:20.605685 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f775b-f1a7-4b71-b8f2-c354af671e0e None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:20.635849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c4f9f-b19f-45b4-963b-26f4486c0cc4 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:20.653516 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:20.671333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a61bf-1a17-413e-bc88-8e29b4f28eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:20.671880 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a61bf-1a17-413e-bc88-8e29b4f28eea None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:20.672169 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a61bf-1a17-413e-bc88-8e29b4f28eea None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:20.672443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a61bf-1a17-413e-bc88-8e29b4f28eea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:20.673167 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a61bf-1a17-413e-bc88-8e29b4f28eea None admin] RBAC: Adding query filter params (role.id=e73a8fc0684c4f6083a71ea9a85c7298, scope.domain.id=default, user.id=5579ecb3986c47e1b18c2e33e293c21b) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:20.673475 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a61bf-1a17-413e-bc88-8e29b4f28eea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:20.674979 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a61bf-1a17-413e-bc88-8e29b4f28eea None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:20.683581 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 27/56] 10.222.0.121 () {56 vars in 1327 bytes} [Fri Aug 26 00:49:20 2022] GET /identity/v3/role_assignments?user.id=5579ecb3986c47e1b18c2e33e293c21b&scope.domain.id=default&role.id=e73a8fc0684c4f6083a71ea9a85c7298 => generated 532 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:20.702071 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:20.713338 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f775b-f1a7-4b71-b8f2-c354af671e0e None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:20.767421 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a6ed0-2b54-465e-92a0-814f22ba331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:20.768106 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a6ed0-2b54-465e-92a0-814f22ba331e None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:20.768386 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a6ed0-2b54-465e-92a0-814f22ba331e None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:20.768660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a6ed0-2b54-465e-92a0-814f22ba331e None admin] PATH_INFO: `/v3/projects` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:20.769362 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a6ed0-2b54-465e-92a0-814f22ba331e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:20.770891 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a6ed0-2b54-465e-92a0-814f22ba331e None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:20.884077 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 30/57] 10.222.0.121 () {60 vars in 1145 bytes} [Fri Aug 26 00:49:20 2022] POST /identity/v3/projects => generated 299 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:49:23.076854 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbde342-a315-4e37-8f50-8271dab8d6b6 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:23.077436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbde342-a315-4e37-8f50-8271dab8d6b6 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:23.077436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbde342-a315-4e37-8f50-8271dab8d6b6 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:23.079249 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 28/58] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:23.084465 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e7d24-0545-420a-bbcb-e6568a6b497a None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:23.084880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e7d24-0545-420a-bbcb-e6568a6b497a None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:23.085037 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e7d24-0545-420a-bbcb-e6568a6b497a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:23.103446 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-8f3e7d24-0545-420a-bbcb-e6568a6b497a None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:23.104659 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-8f3e7d24-0545-420a-bbcb-e6568a6b497a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:23.170703 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 31/59] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:23.513238 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbde342-a315-4e37-8f50-8271dab8d6b6 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:23.612932 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbde342-a315-4e37-8f50-8271dab8d6b6 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:23.646180 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac81dfb-e416-457b-b203-ece5f30f6c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:23.646807 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac81dfb-e416-457b-b203-ece5f30f6c57 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:23.647128 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac81dfb-e416-457b-b203-ece5f30f6c57 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:23.647397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac81dfb-e416-457b-b203-ece5f30f6c57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:23.648542 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac81dfb-e416-457b-b203-ece5f30f6c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:23.650006 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac81dfb-e416-457b-b203-ece5f30f6c57 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:23.651609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 29/60] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:49:23 2022] GET /identity/v3/domains/default => generated 200 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:23.657327 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e7d24-0545-420a-bbcb-e6568a6b497a None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:23.725768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:23.754552 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e7d24-0545-420a-bbcb-e6568a6b497a None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:23.787951 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcd362-9c16-454c-a2b1-f56533c99594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:23.788486 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcd362-9c16-454c-a2b1-f56533c99594 None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:23.788768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcd362-9c16-454c-a2b1-f56533c99594 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:23.789045 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcd362-9c16-454c-a2b1-f56533c99594 None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:23.789690 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bcd362-9c16-454c-a2b1-f56533c99594 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:23.791253 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bcd362-9c16-454c-a2b1-f56533c99594 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:23.903450 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 32/61] 10.222.0.121 () {60 vars in 1137 bytes} [Fri Aug 26 00:49:23 2022] POST /identity/v3/users => generated 276 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:49:27.329045 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedad68-b493-421d-b29d-3d2440c1b895 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:27.329045 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedad68-b493-421d-b29d-3d2440c1b895 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:27.329045 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedad68-b493-421d-b29d-3d2440c1b895 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:27.329045 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 30/62] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:27.348065 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816520-50c8-4b60-b5ee-110e3a3c45d9 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:27.348801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816520-50c8-4b60-b5ee-110e3a3c45d9 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:27.348801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816520-50c8-4b60-b5ee-110e3a3c45d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:27.385560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-fe816520-50c8-4b60-b5ee-110e3a3c45d9 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:27.386358 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd08ae-67c1-4755-9e96-713dedee3931 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:27.386915 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-fe816520-50c8-4b60-b5ee-110e3a3c45d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:27.387211 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd08ae-67c1-4755-9e96-713dedee3931 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:27.387680 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd08ae-67c1-4755-9e96-713dedee3931 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:27.389257 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 31/63] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:49:27.394873 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5b023-0f2c-4f8f-a2a6-842c3338d01e None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:27.395437 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5b023-0f2c-4f8f-a2a6-842c3338d01e None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:27.395992 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5b023-0f2c-4f8f-a2a6-842c3338d01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:27.420940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-15d5b023-0f2c-4f8f-a2a6-842c3338d01e None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:27.425510 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-15d5b023-0f2c-4f8f-a2a6-842c3338d01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:27.509077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:27.517487 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 33/64] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:27.545601 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 32/65] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:49:27.826616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f329e-4bd0-4e0a-9fba-99723a5b161d None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:27.827363 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f329e-4bd0-4e0a-9fba-99723a5b161d None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:27.827964 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f329e-4bd0-4e0a-9fba-99723a5b161d None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:27.829667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 34/66] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:27.835529 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11128a-8d52-4a80-a931-8a128e6fb33d None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:27.836121 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11128a-8d52-4a80-a931-8a128e6fb33d None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:27.836590 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11128a-8d52-4a80-a931-8a128e6fb33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:27.858547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-ca11128a-8d52-4a80-a931-8a128e6fb33d None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:27.860741 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-ca11128a-8d52-4a80-a931-8a128e6fb33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:27.911106 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f329e-4bd0-4e0a-9fba-99723a5b161d None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:27.961581 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 33/67] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:27.963215 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06f697-27e3-4b3f-aa66-47775cc6fffa None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:27.963644 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06f697-27e3-4b3f-aa66-47775cc6fffa None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:27.964101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06f697-27e3-4b3f-aa66-47775cc6fffa None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:27.965676 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 34/68] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:27.972264 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8280fff-bcfe-4fba-a420-feae358da47b None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:27.972774 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8280fff-bcfe-4fba-a420-feae358da47b None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:27.973220 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8280fff-bcfe-4fba-a420-feae358da47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:27.997094 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-b8280fff-bcfe-4fba-a420-feae358da47b None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:27.999432 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-b8280fff-bcfe-4fba-a420-feae358da47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:28.000573 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:28.052065 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f329e-4bd0-4e0a-9fba-99723a5b161d None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:28.089325 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 35/69] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:28.090449 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8280fff-bcfe-4fba-a420-feae358da47b None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:28.110066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1d1c4-f48d-49d8-bd66-81e07236c8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:28.112462 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1d1c4-f48d-49d8-bd66-81e07236c8df None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:28.113121 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1d1c4-f48d-49d8-bd66-81e07236c8df None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:28.114256 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1d1c4-f48d-49d8-bd66-81e07236c8df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:28.136195 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1d1c4-f48d-49d8-bd66-81e07236c8df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-28b1d1c4-f48d-49d8-bd66-81e07236c8df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:28.143181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:28.144088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:28.144867 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:28.144867 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:28.144867 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:28.144867 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:28.144867 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:28.144867 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:28.144867 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:28.144867 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:28.144867 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:28.144867 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:28.144867 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:28.144867 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:49:28.144867 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 35/70] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:49:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:49:28.145602 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77f7fb-bf11-4af2-8018-6f5387100fe0 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:28.146165 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77f7fb-bf11-4af2-8018-6f5387100fe0 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:28.146589 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77f7fb-bf11-4af2-8018-6f5387100fe0 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:28.148071 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 36/71] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:28.153173 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77f7fb-bf11-4af2-8018-6f5387100fe0 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:28.171816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:28.242279 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8280fff-bcfe-4fba-a420-feae358da47b None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:28.279626 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77f7fb-bf11-4af2-8018-6f5387100fe0 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:28.286531 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7586c-5853-4d77-8a33-d011d9362e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:28.287544 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7586c-5853-4d77-8a33-d011d9362e3c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:28.287994 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7586c-5853-4d77-8a33-d011d9362e3c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:28.288899 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7586c-5853-4d77-8a33-d011d9362e3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:28.301616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:28.303393 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7586c-5853-4d77-8a33-d011d9362e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-c4a7586c-5853-4d77-8a33-d011d9362e3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:28.309715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:28.314669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:28.316224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:28.316224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:28.316224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:28.316224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:28.316224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:28.316224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:28.316224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:28.316224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:28.316224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:28.316224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:28.316224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:28.316224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:28.316224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 36/72] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:28.317699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52fd82-938b-4e49-a16c-e1aa7486b7dd None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:28.318083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52fd82-938b-4e49-a16c-e1aa7486b7dd None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:28.318328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52fd82-938b-4e49-a16c-e1aa7486b7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:28.326252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5cb45-de18-47d5-b9f9-6732b471af2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:28.327009 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5cb45-de18-47d5-b9f9-6732b471af2a None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:28.327362 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5cb45-de18-47d5-b9f9-6732b471af2a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:28.327763 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5cb45-de18-47d5-b9f9-6732b471af2a None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:28.329016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5cb45-de18-47d5-b9f9-6732b471af2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:28.329401 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5cb45-de18-47d5-b9f9-6732b471af2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:28.331050 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5cb45-de18-47d5-b9f9-6732b471af2a None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:28.337190 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-9e52fd82-938b-4e49-a16c-e1aa7486b7dd None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:28.338404 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-9e52fd82-938b-4e49-a16c-e1aa7486b7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:28.342052 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 37/73] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:28 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:28.343047 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5cb45-de18-47d5-b9f9-6732b471af2a None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:28.429882 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 37/74] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:28.431075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52fd82-938b-4e49-a16c-e1aa7486b7dd None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:28.480995 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:28.482447 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5cb45-de18-47d5-b9f9-6732b471af2a None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:28.520844 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e122a3-77aa-4bdb-ad3f-515fb488b3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:28.521532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e122a3-77aa-4bdb-ad3f-515fb488b3d1 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:28.521850 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e122a3-77aa-4bdb-ad3f-515fb488b3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:28.522124 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e122a3-77aa-4bdb-ad3f-515fb488b3d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:28.533208 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e122a3-77aa-4bdb-ad3f-515fb488b3d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-a6e122a3-77aa-4bdb-ad3f-515fb488b3d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:28.538415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:28.539329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:28.540092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:28.540092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:28.540092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:28.540092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:28.540092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:28.540092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:28.540092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:28.540092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:28.540092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:28.540092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:28.540092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:49:28.540092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:49:28.540092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 38/75] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:49:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:28.545211 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e122a3-77aa-4bdb-ad3f-515fb488b3d1 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:28.571017 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52fd82-938b-4e49-a16c-e1aa7486b7dd None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:28.597630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:28.607404 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849b4ef-2c18-4fee-8ef4-e0b18c4d1fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:28.611157 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849b4ef-2c18-4fee-8ef4-e0b18c4d1fd6 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:28.611157 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849b4ef-2c18-4fee-8ef4-e0b18c4d1fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:28.611157 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849b4ef-2c18-4fee-8ef4-e0b18c4d1fd6 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:28.611157 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849b4ef-2c18-4fee-8ef4-e0b18c4d1fd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:28.611157 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849b4ef-2c18-4fee-8ef4-e0b18c4d1fd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:28.611157 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849b4ef-2c18-4fee-8ef4-e0b18c4d1fd6 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:28.620046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 38/76] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:49:28 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:28.624824 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849b4ef-2c18-4fee-8ef4-e0b18c4d1fd6 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:28.663871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e122a3-77aa-4bdb-ad3f-515fb488b3d1 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:28.699944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21fe2b-56a8-4392-85d9-915e854b1956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:28.700579 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21fe2b-56a8-4392-85d9-915e854b1956 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:28.700859 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21fe2b-56a8-4392-85d9-915e854b1956 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:28.701132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21fe2b-56a8-4392-85d9-915e854b1956 None admin] PATH_INFO: `/v3/users/5579ecb3986c47e1b18c2e33e293c21b` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:28.702304 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21fe2b-56a8-4392-85d9-915e854b1956 None admin] RBAC: Authorizing `identity:get_user(user_id=5579ecb3986c47e1b18c2e33e293c21b)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:28.704379 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21fe2b-56a8-4392-85d9-915e854b1956 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:28.705964 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 39/77] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:28 2022] GET /identity/v3/users/5579ecb3986c47e1b18c2e33e293c21b => generated 248 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:28.710448 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21fe2b-56a8-4392-85d9-915e854b1956 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:28.725745 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:28.735292 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849b4ef-2c18-4fee-8ef4-e0b18c4d1fd6 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:28.777695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19832a0b-8df6-4006-8a20-bf0ed4b1184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:28.778565 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19832a0b-8df6-4006-8a20-bf0ed4b1184b None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:28.778878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19832a0b-8df6-4006-8a20-bf0ed4b1184b None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:28.779177 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19832a0b-8df6-4006-8a20-bf0ed4b1184b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:28.790033 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19832a0b-8df6-4006-8a20-bf0ed4b1184b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-19832a0b-8df6-4006-8a20-bf0ed4b1184b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:28.794858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:28.795757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:28.796838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:28.796838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:28.796838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:28.796838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:28.796838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:28.796838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:28.796838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:28.796838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:28.796838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:28.796838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:28.796838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:28.796838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:28.796838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 39/78] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:28.796838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19832a0b-8df6-4006-8a20-bf0ed4b1184b None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:28.817293 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21fe2b-56a8-4392-85d9-915e854b1956 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:28.826750 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:28.855329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb718b-df2e-4ead-a56f-8ca1c62a2ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:28.855861 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb718b-df2e-4ead-a56f-8ca1c62a2ccb None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:28.856152 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb718b-df2e-4ead-a56f-8ca1c62a2ccb None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:28.856427 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb718b-df2e-4ead-a56f-8ca1c62a2ccb None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:28.857103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb718b-df2e-4ead-a56f-8ca1c62a2ccb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:28.857407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb718b-df2e-4ead-a56f-8ca1c62a2ccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:28.858925 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb718b-df2e-4ead-a56f-8ca1c62a2ccb None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:28.868878 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 40/79] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:49:28 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:28.869638 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb718b-df2e-4ead-a56f-8ca1c62a2ccb None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:28.905399 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19832a0b-8df6-4006-8a20-bf0ed4b1184b None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:28.939860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a742b4a-763d-4a50-85fe-15d65b94b998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:28.940505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a742b4a-763d-4a50-85fe-15d65b94b998 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:28.940791 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a742b4a-763d-4a50-85fe-15d65b94b998 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:28.941072 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a742b4a-763d-4a50-85fe-15d65b94b998 None admin] PATH_INFO: `/v3/users/ee496f6834d34c428eca652ff60963ba` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:28.957347 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a742b4a-763d-4a50-85fe-15d65b94b998 None admin] RBAC: Authorizing `identity:get_user(user_id=ee496f6834d34c428eca652ff60963ba)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:28.958860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a742b4a-763d-4a50-85fe-15d65b94b998 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:28.960524 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 40/80] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:28 2022] GET /identity/v3/users/ee496f6834d34c428eca652ff60963ba => generated 276 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:28.960524 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a742b4a-763d-4a50-85fe-15d65b94b998 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:28.973132 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:28.978139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb718b-df2e-4ead-a56f-8ca1c62a2ccb None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:29.014579 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9caed1-28ba-4171-bb06-ec274c1b37be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:29.015224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9caed1-28ba-4171-bb06-ec274c1b37be None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:29.015507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9caed1-28ba-4171-bb06-ec274c1b37be None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:29.015784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9caed1-28ba-4171-bb06-ec274c1b37be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:29.055275 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:29.070979 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a742b4a-763d-4a50-85fe-15d65b94b998 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:29.090386 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9caed1-28ba-4171-bb06-ec274c1b37be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:29.091938 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9caed1-28ba-4171-bb06-ec274c1b37be None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:29.110393 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ecbde-4328-4687-8fa6-9841c6e0111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:29.110983 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ecbde-4328-4687-8fa6-9841c6e0111d None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:29.111269 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ecbde-4328-4687-8fa6-9841c6e0111d None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:29.111546 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ecbde-4328-4687-8fa6-9841c6e0111d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:29.112743 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ecbde-4328-4687-8fa6-9841c6e0111d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:29.114413 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ecbde-4328-4687-8fa6-9841c6e0111d None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:29.116030 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 41/81] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:49:28 2022] GET /identity/v3/domains/default => generated 200 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:29.116865 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ecbde-4328-4687-8fa6-9841c6e0111d None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:29.202348 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:29.202669 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 41/82] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:28 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:49:29.203752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9caed1-28ba-4171-bb06-ec274c1b37be None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:29.225756 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ecbde-4328-4687-8fa6-9841c6e0111d None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:29.260444 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49db07-48a2-477d-8951-0751c99c33a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:29.261054 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49db07-48a2-477d-8951-0751c99c33a0 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:29.261338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49db07-48a2-477d-8951-0751c99c33a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:29.261618 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49db07-48a2-477d-8951-0751c99c33a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:29.262340 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49db07-48a2-477d-8951-0751c99c33a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:29.262650 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49db07-48a2-477d-8951-0751c99c33a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:29.264095 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49db07-48a2-477d-8951-0751c99c33a0 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:29.272321 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 42/83] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:49:29 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:29.272461 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:29.273139 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49db07-48a2-477d-8951-0751c99c33a0 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:29.309593 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9caed1-28ba-4171-bb06-ec274c1b37be None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:29.344566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a0e7c-9033-445a-a0a1-f9a04f83df68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:29.345204 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a0e7c-9033-445a-a0a1-f9a04f83df68 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:29.345491 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a0e7c-9033-445a-a0a1-f9a04f83df68 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:29.345803 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a0e7c-9033-445a-a0a1-f9a04f83df68 None admin] PATH_INFO: `/v3/users/ee496f6834d34c428eca652ff60963ba` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:29.346939 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a0e7c-9033-445a-a0a1-f9a04f83df68 None admin] RBAC: Authorizing `identity:get_user(user_id=ee496f6834d34c428eca652ff60963ba)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:29.348437 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a0e7c-9033-445a-a0a1-f9a04f83df68 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:29.350064 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 42/84] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:29 2022] GET /identity/v3/users/ee496f6834d34c428eca652ff60963ba => generated 276 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:29.351710 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a0e7c-9033-445a-a0a1-f9a04f83df68 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:29.374185 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49db07-48a2-477d-8951-0751c99c33a0 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:29.408613 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dda44-5d8f-4465-a78a-a6f631aba873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:29.409230 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dda44-5d8f-4465-a78a-a6f631aba873 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:29.409514 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dda44-5d8f-4465-a78a-a6f631aba873 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:29.409792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dda44-5d8f-4465-a78a-a6f631aba873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:29.421380 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:29.476543 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a0e7c-9033-445a-a0a1-f9a04f83df68 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:29.494134 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721dda44-5d8f-4465-a78a-a6f631aba873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:29.495676 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721dda44-5d8f-4465-a78a-a6f631aba873 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:29.511466 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd526c3-8417-4452-b343-32a375107bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:29.512082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd526c3-8417-4452-b343-32a375107bbb None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:29.512365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd526c3-8417-4452-b343-32a375107bbb None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:29.512674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd526c3-8417-4452-b343-32a375107bbb None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:29.513292 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd526c3-8417-4452-b343-32a375107bbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:29.514763 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd526c3-8417-4452-b343-32a375107bbb None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:29.525185 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:29.602105 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 43/85] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:29 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:49:29.602983 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dda44-5d8f-4465-a78a-a6f631aba873 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:29.643677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:29.651730 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 43/86] 10.222.0.121 () {60 vars in 1137 bytes} [Fri Aug 26 00:49:29 2022] POST /identity/v3/users => generated 290 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:49:29.652411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd526c3-8417-4452-b343-32a375107bbb None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:29.715476 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721dda44-5d8f-4465-a78a-a6f631aba873 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:29.764514 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd526c3-8417-4452-b343-32a375107bbb None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:29.764710 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ba255-c50c-4612-ab3f-53659d0f5f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:29.765266 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ba255-c50c-4612-ab3f-53659d0f5f85 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:29.765506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ba255-c50c-4612-ab3f-53659d0f5f85 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:29.765787 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ba255-c50c-4612-ab3f-53659d0f5f85 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:29.768911 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ba255-c50c-4612-ab3f-53659d0f5f85 None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:29.770448 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ba255-c50c-4612-ab3f-53659d0f5f85 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:29.777878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 44/87] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:29 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:29.777878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ba255-c50c-4612-ab3f-53659d0f5f85 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:29.805626 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6c221-458f-4115-a02a-fd0472df3d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:29.806280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6c221-458f-4115-a02a-fd0472df3d76 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:29.806568 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6c221-458f-4115-a02a-fd0472df3d76 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:29.806942 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6c221-458f-4115-a02a-fd0472df3d76 None admin] PATH_INFO: `/v3/users/ee496f6834d34c428eca652ff60963ba` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:29.808179 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6c221-458f-4115-a02a-fd0472df3d76 None admin] RBAC: Authorizing `identity:get_user(user_id=ee496f6834d34c428eca652ff60963ba)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:29.809684 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6c221-458f-4115-a02a-fd0472df3d76 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:29.811464 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 44/88] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:29 2022] GET /identity/v3/users/ee496f6834d34c428eca652ff60963ba => generated 276 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:29.812265 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6c221-458f-4115-a02a-fd0472df3d76 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:29.886959 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:29.912517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ba255-c50c-4612-ab3f-53659d0f5f85 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:29.922463 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:29.943975 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6c221-458f-4115-a02a-fd0472df3d76 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:29.958066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96229ab0-124d-4a2d-9a38-0ac9e63189e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:29.959318 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96229ab0-124d-4a2d-9a38-0ac9e63189e3 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:29.959318 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96229ab0-124d-4a2d-9a38-0ac9e63189e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:29.959536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96229ab0-124d-4a2d-9a38-0ac9e63189e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:29.997117 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ad62b-dd36-455d-956b-9ceea3570b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:29.999432 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ad62b-dd36-455d-956b-9ceea3570b05 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:29.999432 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ad62b-dd36-455d-956b-9ceea3570b05 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:29.999432 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ad62b-dd36-455d-956b-9ceea3570b05 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:29.999677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ad62b-dd36-455d-956b-9ceea3570b05 None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:30.001831 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ad62b-dd36-455d-956b-9ceea3570b05 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:30.003751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 45/89] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:29 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:30.006248 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ad62b-dd36-455d-956b-9ceea3570b05 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:30.059040 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96229ab0-124d-4a2d-9a38-0ac9e63189e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:30.061141 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96229ab0-124d-4a2d-9a38-0ac9e63189e3 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:30.127110 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ad62b-dd36-455d-956b-9ceea3570b05 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:30.166017 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:30.175557 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7f644-eadb-4059-8fa4-79ed73b350cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:30.176699 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7f644-eadb-4059-8fa4-79ed73b350cc None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:30.177176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7f644-eadb-4059-8fa4-79ed73b350cc None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:30.178157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7f644-eadb-4059-8fa4-79ed73b350cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:30.179322 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7f644-eadb-4059-8fa4-79ed73b350cc None admin] RBAC: Adding query filter params (role.id=e73a8fc0684c4f6083a71ea9a85c7298, scope.project.id=bc381ac268c74ac7aac2f833ee1437e2, user.id=5579ecb3986c47e1b18c2e33e293c21b) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:30.179811 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7f644-eadb-4059-8fa4-79ed73b350cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:30.182143 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7f644-eadb-4059-8fa4-79ed73b350cc None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:30.191329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 46/90] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:30 2022] GET /identity/v3/role_assignments?user.id=5579ecb3986c47e1b18c2e33e293c21b&scope.project.id=bc381ac268c74ac7aac2f833ee1437e2&role.id=e73a8fc0684c4f6083a71ea9a85c7298 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:30.192500 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7f644-eadb-4059-8fa4-79ed73b350cc None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:30.209420 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 45/91] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:29 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:49:30.209939 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96229ab0-124d-4a2d-9a38-0ac9e63189e3 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:30.231529 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:30.334344 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7f644-eadb-4059-8fa4-79ed73b350cc None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:30.380222 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96229ab0-124d-4a2d-9a38-0ac9e63189e3 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:30.386922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185df9ea-cce3-4d75-bad4-a76305fa1b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:30.388997 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185df9ea-cce3-4d75-bad4-a76305fa1b6f None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:30.388997 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185df9ea-cce3-4d75-bad4-a76305fa1b6f None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:30.388997 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185df9ea-cce3-4d75-bad4-a76305fa1b6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:30.429966 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e3d07-a513-4c9d-8376-d77b14cbd1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:30.429966 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e3d07-a513-4c9d-8376-d77b14cbd1e0 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:30.429966 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e3d07-a513-4c9d-8376-d77b14cbd1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:30.429966 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e3d07-a513-4c9d-8376-d77b14cbd1e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:30.430407 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e3d07-a513-4c9d-8376-d77b14cbd1e0 None admin] RBAC: Adding query filter params (role.id=8acc6a2016c149a0b80cf3c56b5ae91a, scope.project.id=bc381ac268c74ac7aac2f833ee1437e2, user.id=ee496f6834d34c428eca652ff60963ba) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:30.430407 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e3d07-a513-4c9d-8376-d77b14cbd1e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:30.430407 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e3d07-a513-4c9d-8376-d77b14cbd1e0 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:30.435297 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 46/92] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:30 2022] GET /identity/v3/role_assignments?user.id=ee496f6834d34c428eca652ff60963ba&scope.project.id=bc381ac268c74ac7aac2f833ee1437e2&role.id=8acc6a2016c149a0b80cf3c56b5ae91a => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:30.436133 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e3d07-a513-4c9d-8376-d77b14cbd1e0 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:30.516136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:30.527218 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185df9ea-cce3-4d75-bad4-a76305fa1b6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:30.529305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185df9ea-cce3-4d75-bad4-a76305fa1b6f None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:30.654156 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 47/93] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:30 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:49:30.660520 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185df9ea-cce3-4d75-bad4-a76305fa1b6f None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:30.662994 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:30.746971 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e3d07-a513-4c9d-8376-d77b14cbd1e0 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:30.787228 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:30.793578 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11c2a4-d3d2-4243-8403-0db758427cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:30.800430 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11c2a4-d3d2-4243-8403-0db758427cf4 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:30.800430 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11c2a4-d3d2-4243-8403-0db758427cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:30.800430 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11c2a4-d3d2-4243-8403-0db758427cf4 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:30.800430 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11c2a4-d3d2-4243-8403-0db758427cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:30.800430 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11c2a4-d3d2-4243-8403-0db758427cf4 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:30.802286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 47/94] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:30 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:30.809350 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185df9ea-cce3-4d75-bad4-a76305fa1b6f None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:30.813656 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11c2a4-d3d2-4243-8403-0db758427cf4 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:30.887328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeccac-df7d-4ef8-9b05-ad7b642470e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:30.887997 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeccac-df7d-4ef8-9b05-ad7b642470e8 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:30.889373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeccac-df7d-4ef8-9b05-ad7b642470e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:30.889653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeccac-df7d-4ef8-9b05-ad7b642470e8 None admin] PATH_INFO: `/v3/projects/21c7a35fa5c645109701347bd9cf0677` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:30.899865 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eeccac-df7d-4ef8-9b05-ad7b642470e8 None admin] RBAC: Authorizing `identity:get_project(project_id=21c7a35fa5c645109701347bd9cf0677)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:30.901472 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eeccac-df7d-4ef8-9b05-ad7b642470e8 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:30.904462 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 48/95] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:30 2022] GET /identity/v3/projects/21c7a35fa5c645109701347bd9cf0677 => generated 313 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:30.914884 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeccac-df7d-4ef8-9b05-ad7b642470e8 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:31.049942 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11c2a4-d3d2-4243-8403-0db758427cf4 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:31.100040 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeccac-df7d-4ef8-9b05-ad7b642470e8 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:31.134523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d031d-1f00-4f56-a2fc-10e81b29f50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:31.135181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d031d-1f00-4f56-a2fc-10e81b29f50b None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:31.135576 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d031d-1f00-4f56-a2fc-10e81b29f50b None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:31.135966 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d031d-1f00-4f56-a2fc-10e81b29f50b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:31.136704 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d031d-1f00-4f56-a2fc-10e81b29f50b None admin] RBAC: Adding query filter params (role.id=034b8b83b5934694bebbf0e19a81dc15, scope.project.id=bc381ac268c74ac7aac2f833ee1437e2, user.id=ee496f6834d34c428eca652ff60963ba) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:31.136921 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f3bdf-e816-4aa2-a1ec-0850e33d31c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:31.137030 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d031d-1f00-4f56-a2fc-10e81b29f50b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:31.137527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f3bdf-e816-4aa2-a1ec-0850e33d31c9 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:31.137807 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f3bdf-e816-4aa2-a1ec-0850e33d31c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:31.138080 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f3bdf-e816-4aa2-a1ec-0850e33d31c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:31.138470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d031d-1f00-4f56-a2fc-10e81b29f50b None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:31.138798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f3bdf-e816-4aa2-a1ec-0850e33d31c9 None admin] RBAC: Adding query filter params (role.id=8acc6a2016c149a0b80cf3c56b5ae91a, scope.project.id=21c7a35fa5c645109701347bd9cf0677, user.id=ee496f6834d34c428eca652ff60963ba) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:31.139135 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f3bdf-e816-4aa2-a1ec-0850e33d31c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:31.141585 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f3bdf-e816-4aa2-a1ec-0850e33d31c9 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:31.147671 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 49/96] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:30 2022] GET /identity/v3/role_assignments?user.id=ee496f6834d34c428eca652ff60963ba&scope.project.id=21c7a35fa5c645109701347bd9cf0677&role.id=8acc6a2016c149a0b80cf3c56b5ae91a => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:31.150293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 48/97] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:30 2022] GET /identity/v3/role_assignments?user.id=ee496f6834d34c428eca652ff60963ba&scope.project.id=bc381ac268c74ac7aac2f833ee1437e2&role.id=034b8b83b5934694bebbf0e19a81dc15 => generated 260 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:32.589097 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a5785-281b-4226-bdc9-41d6db0aa8b5 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:32.589604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a5785-281b-4226-bdc9-41d6db0aa8b5 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:32.589714 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a5785-281b-4226-bdc9-41d6db0aa8b5 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:32.591379 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 50/98] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:32.597543 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d5def-4b08-47da-b6da-0d2b471a6580 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:32.598008 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d5def-4b08-47da-b6da-0d2b471a6580 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:32.598111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d5def-4b08-47da-b6da-0d2b471a6580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:32.611904 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:32.623856 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-e20d5def-4b08-47da-b6da-0d2b471a6580 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:32.625096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-e20d5def-4b08-47da-b6da-0d2b471a6580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:32.713148 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 49/99] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:33.321337 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63338cff-ec81-4e7e-832b-6625edaac16b None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:33.321618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63338cff-ec81-4e7e-832b-6625edaac16b None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:33.322147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63338cff-ec81-4e7e-832b-6625edaac16b None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:33.324067 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 51/100] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:33.330149 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3055528-8618-44d5-a813-7b9a0df69220 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:33.330765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3055528-8618-44d5-a813-7b9a0df69220 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:33.331310 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3055528-8618-44d5-a813-7b9a0df69220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:33.351205 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-c3055528-8618-44d5-a813-7b9a0df69220 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:33.352821 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-c3055528-8618-44d5-a813-7b9a0df69220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:33.400778 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63338cff-ec81-4e7e-832b-6625edaac16b None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:33.465637 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:33.466268 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 50/101] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:33.548482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c0252-cc84-4c37-ae16-4a98ded809a7 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:33.549581 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c0252-cc84-4c37-ae16-4a98ded809a7 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:33.550063 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c0252-cc84-4c37-ae16-4a98ded809a7 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:33.552359 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 51/102] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:33 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:33.559254 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816ce4f-550d-430c-b69e-6283875d813a None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:33.559818 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816ce4f-550d-430c-b69e-6283875d813a None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:33.560102 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816ce4f-550d-430c-b69e-6283875d813a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:33.601933 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-2816ce4f-550d-430c-b69e-6283875d813a None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:33.603169 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-2816ce4f-550d-430c-b69e-6283875d813a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:33.610099 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63338cff-ec81-4e7e-832b-6625edaac16b None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:33.696344 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efdc7b-1ba9-490e-b131-e11001b17dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:33.697015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efdc7b-1ba9-490e-b131-e11001b17dfa None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:33.697299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efdc7b-1ba9-490e-b131-e11001b17dfa None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:33.697580 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efdc7b-1ba9-490e-b131-e11001b17dfa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:33.719511 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:33.731594 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 52/103] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:49:33.739843 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efdc7b-1ba9-490e-b131-e11001b17dfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-e8efdc7b-1ba9-490e-b131-e11001b17dfa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:33.745383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:33.746226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:33.747041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:33.747041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:33.747041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:33.747041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:33.747041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:33.747041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:33.747041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:33.747041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:33.747041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:33.747041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:33.747041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:49:33.747041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:49:33.747041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 52/104] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:49:33.754036 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816ce4f-550d-430c-b69e-6283875d813a None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:33.873416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816ce4f-550d-430c-b69e-6283875d813a None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:33.914360 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e9c08-7bf5-4409-9a10-1d69494bde32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:33.915022 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e9c08-7bf5-4409-9a10-1d69494bde32 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:33.915314 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e9c08-7bf5-4409-9a10-1d69494bde32 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:33.915594 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e9c08-7bf5-4409-9a10-1d69494bde32 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:33.916277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e9c08-7bf5-4409-9a10-1d69494bde32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:33.916585 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e9c08-7bf5-4409-9a10-1d69494bde32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:33.917996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e9c08-7bf5-4409-9a10-1d69494bde32 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:33.927838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 53/105] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:49:33 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:33.933842 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efdc7b-1ba9-490e-b131-e11001b17dfa None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:33.962367 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e9c08-7bf5-4409-9a10-1d69494bde32 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:34.075458 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:34.088748 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:34.133048 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efdc7b-1ba9-490e-b131-e11001b17dfa None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:34.148144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e9c08-7bf5-4409-9a10-1d69494bde32 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:34.187103 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea5e25-8be5-45e7-88d4-29b970291239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:34.188152 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea5e25-8be5-45e7-88d4-29b970291239 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:34.188630 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea5e25-8be5-45e7-88d4-29b970291239 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:34.189102 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea5e25-8be5-45e7-88d4-29b970291239 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:34.190472 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea5e25-8be5-45e7-88d4-29b970291239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:34.192289 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea5e25-8be5-45e7-88d4-29b970291239 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:34.194404 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 54/106] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:49:33 2022] GET /identity/v3/domains/default => generated 200 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:34.201087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea5e25-8be5-45e7-88d4-29b970291239 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:34.219940 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961732f5-e5fa-474a-adff-1825b8fa027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:34.220608 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961732f5-e5fa-474a-adff-1825b8fa027d None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:34.227916 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961732f5-e5fa-474a-adff-1825b8fa027d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:34.227916 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961732f5-e5fa-474a-adff-1825b8fa027d None admin] PATH_INFO: `/v3/users/1d64cfc4d5584597927d6e4b566654f4` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:34.250918 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961732f5-e5fa-474a-adff-1825b8fa027d None admin] RBAC: Authorizing `identity:get_user(user_id=1d64cfc4d5584597927d6e4b566654f4)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:34.253286 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961732f5-e5fa-474a-adff-1825b8fa027d None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:34.255485 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 53/107] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:33 2022] GET /identity/v3/users/1d64cfc4d5584597927d6e4b566654f4 => generated 290 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:34.263742 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961732f5-e5fa-474a-adff-1825b8fa027d None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:34.388416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea5e25-8be5-45e7-88d4-29b970291239 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:34.430835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:34.459702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d021a-2a5a-44b2-9824-e03e5c437d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:34.460659 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d021a-2a5a-44b2-9824-e03e5c437d7e None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:34.461242 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d021a-2a5a-44b2-9824-e03e5c437d7e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:34.461918 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d021a-2a5a-44b2-9824-e03e5c437d7e None admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:34.463804 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d021a-2a5a-44b2-9824-e03e5c437d7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:34.468075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d021a-2a5a-44b2-9824-e03e5c437d7e None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:34.499744 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961732f5-e5fa-474a-adff-1825b8fa027d None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:34.537951 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfae7d6-b420-48eb-8dd9-6368362c058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:34.538583 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfae7d6-b420-48eb-8dd9-6368362c058a None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:34.538905 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfae7d6-b420-48eb-8dd9-6368362c058a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:34.539184 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfae7d6-b420-48eb-8dd9-6368362c058a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:34.555094 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:34.590627 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 55/108] 10.222.0.121 () {60 vars in 1146 bytes} [Fri Aug 26 00:49:34 2022] POST /identity/v3/projects => generated 303 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:49:34.592051 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507ccc2-228c-45b9-8cb5-da59c32da3c9 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:34.592347 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507ccc2-228c-45b9-8cb5-da59c32da3c9 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:34.592595 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507ccc2-228c-45b9-8cb5-da59c32da3c9 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:34.593943 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 56/109] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:34.599219 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507ccc2-228c-45b9-8cb5-da59c32da3c9 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:34.630812 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfae7d6-b420-48eb-8dd9-6368362c058a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:34.633077 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfae7d6-b420-48eb-8dd9-6368362c058a None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:34.745592 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507ccc2-228c-45b9-8cb5-da59c32da3c9 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:34.775373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 54/110] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:34 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:49:34.775373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951d12c-72e9-4ed2-8a65-10c9736974e7 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:34.775373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951d12c-72e9-4ed2-8a65-10c9736974e7 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:34.775373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951d12c-72e9-4ed2-8a65-10c9736974e7 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:34.775373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 55/111] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:34.775373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d7e7a-a4b9-4167-8c21-4e5a7d413fb1 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:34.775373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d7e7a-a4b9-4167-8c21-4e5a7d413fb1 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:34.775984 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d7e7a-a4b9-4167-8c21-4e5a7d413fb1 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:34.775984 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 56/112] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:34.775984 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea161343-58eb-4786-b5a5-ae9c47b8c042 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:34.775984 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea161343-58eb-4786-b5a5-ae9c47b8c042 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:34.775984 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea161343-58eb-4786-b5a5-ae9c47b8c042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:34.795326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-ea161343-58eb-4786-b5a5-ae9c47b8c042 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:34.797424 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-ea161343-58eb-4786-b5a5-ae9c47b8c042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:34.799385 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01465e-4923-4374-80e7-1a1d75177a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:34.801088 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01465e-4923-4374-80e7-1a1d75177a0e None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:34.801088 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01465e-4923-4374-80e7-1a1d75177a0e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:34.801088 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01465e-4923-4374-80e7-1a1d75177a0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:34.815148 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01465e-4923-4374-80e7-1a1d75177a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-eb01465e-4923-4374-80e7-1a1d75177a0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:34.820194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:34.821276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:34.822182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:34.822182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:34.822182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:34.822182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:34.822182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:34.822182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:34.822182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:34.822182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:34.822182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:34.822182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:34.822182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:34.822182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:34.822182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 57/113] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:34.823233 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01465e-4923-4374-80e7-1a1d75177a0e None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:34.856083 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:34.871125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:34.890670 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 57/114] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:34.892302 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e009-44c4-4fbd-a1e3-923c4ab6e02b None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:34.892686 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e009-44c4-4fbd-a1e3-923c4ab6e02b None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:34.892949 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e009-44c4-4fbd-a1e3-923c4ab6e02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:34.912456 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-c739e009-44c4-4fbd-a1e3-923c4ab6e02b None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:34.913941 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-c739e009-44c4-4fbd-a1e3-923c4ab6e02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:34.975570 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01465e-4923-4374-80e7-1a1d75177a0e None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:35.009062 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 58/115] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:35.010664 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806ce35-a89b-46e9-b152-5c708f1a2ba5 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:35.011152 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806ce35-a89b-46e9-b152-5c708f1a2ba5 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:35.011598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806ce35-a89b-46e9-b152-5c708f1a2ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:35.027802 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e7614-f5ec-4a77-99d5-39ce352f665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:35.028581 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e7614-f5ec-4a77-99d5-39ce352f665a None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:35.028951 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e7614-f5ec-4a77-99d5-39ce352f665a None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:35.029297 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e7614-f5ec-4a77-99d5-39ce352f665a None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:35.032541 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-2806ce35-a89b-46e9-b152-5c708f1a2ba5 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:35.034017 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-2806ce35-a89b-46e9-b152-5c708f1a2ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:35.035586 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e7614-f5ec-4a77-99d5-39ce352f665a None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:35.037268 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e7614-f5ec-4a77-99d5-39ce352f665a None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:35.039182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 58/116] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:34 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:35.040042 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e7614-f5ec-4a77-99d5-39ce352f665a None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:35.111316 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 59/117] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:35.112601 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806ce35-a89b-46e9-b152-5c708f1a2ba5 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:35.154395 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:35.180119 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e7614-f5ec-4a77-99d5-39ce352f665a None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:35.182671 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:35.222890 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126884a-9e9c-4201-9ddc-22ded23773a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:35.223515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126884a-9e9c-4201-9ddc-22ded23773a2 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:35.223941 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126884a-9e9c-4201-9ddc-22ded23773a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:35.224493 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126884a-9e9c-4201-9ddc-22ded23773a2 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:35.225177 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126884a-9e9c-4201-9ddc-22ded23773a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:35.225590 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126884a-9e9c-4201-9ddc-22ded23773a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:35.227164 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126884a-9e9c-4201-9ddc-22ded23773a2 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:35.229729 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806ce35-a89b-46e9-b152-5c708f1a2ba5 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:35.237434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 59/118] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:35 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:35.243380 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126884a-9e9c-4201-9ddc-22ded23773a2 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:35.269957 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbf49b-d9a2-455b-b55c-f2ce266b764f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:35.271096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbf49b-d9a2-455b-b55c-f2ce266b764f None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:35.271702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbf49b-d9a2-455b-b55c-f2ce266b764f None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:35.272197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbf49b-d9a2-455b-b55c-f2ce266b764f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:35.273178 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbf49b-d9a2-455b-b55c-f2ce266b764f None admin] RBAC: Adding query filter params (role.id=c89a332a133c4bc7b2a9a1ba7b599dd8, scope.project.id=bc381ac268c74ac7aac2f833ee1437e2, user.id=1d64cfc4d5584597927d6e4b566654f4) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:35.273689 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbf49b-d9a2-455b-b55c-f2ce266b764f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:35.275729 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbf49b-d9a2-455b-b55c-f2ce266b764f None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:35.282303 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 60/119] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:35 2022] GET /identity/v3/role_assignments?user.id=1d64cfc4d5584597927d6e4b566654f4&scope.project.id=bc381ac268c74ac7aac2f833ee1437e2&role.id=c89a332a133c4bc7b2a9a1ba7b599dd8 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:35.355220 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126884a-9e9c-4201-9ddc-22ded23773a2 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:35.396363 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128bc5e8-45cd-436e-a8f1-bc34c820ed43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:35.397040 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bc5e8-45cd-436e-a8f1-bc34c820ed43 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:35.397517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bc5e8-45cd-436e-a8f1-bc34c820ed43 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:35.397887 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bc5e8-45cd-436e-a8f1-bc34c820ed43 None admin] PATH_INFO: `/v3/users/5579ecb3986c47e1b18c2e33e293c21b` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:35.399222 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128bc5e8-45cd-436e-a8f1-bc34c820ed43 None admin] RBAC: Authorizing `identity:get_user(user_id=5579ecb3986c47e1b18c2e33e293c21b)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:35.400986 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128bc5e8-45cd-436e-a8f1-bc34c820ed43 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:35.402841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 60/120] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:35 2022] GET /identity/v3/users/5579ecb3986c47e1b18c2e33e293c21b => generated 248 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:35.409235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbf49b-d9a2-455b-b55c-f2ce266b764f None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:35.409855 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128bc5e8-45cd-436e-a8f1-bc34c820ed43 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:35.451666 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:35.528945 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128bc5e8-45cd-436e-a8f1-bc34c820ed43 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:35.593528 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cd160-dfbc-4c3f-801d-1cdef096a4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:35.595105 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cd160-dfbc-4c3f-801d-1cdef096a4f4 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:35.595563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cd160-dfbc-4c3f-801d-1cdef096a4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:35.596047 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cd160-dfbc-4c3f-801d-1cdef096a4f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:35.609800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:35.610764 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cd160-dfbc-4c3f-801d-1cdef096a4f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-210cd160-dfbc-4c3f-801d-1cdef096a4f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:35.616555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:35.623011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:35.623963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:35.623963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:35.623963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:35.623963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:35.623963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:35.623963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:35.623963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:35.623963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:35.623963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:35.623963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:35.623963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:35.623963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:35.623963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 61/121] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:49:35.623963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cd160-dfbc-4c3f-801d-1cdef096a4f4 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:35.624791 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbf49b-d9a2-455b-b55c-f2ce266b764f None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:35.690607 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982ddc1-bd2e-427d-bd69-f74acdd58f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:35.691317 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982ddc1-bd2e-427d-bd69-f74acdd58f8e None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:35.691813 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982ddc1-bd2e-427d-bd69-f74acdd58f8e None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:35.691928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982ddc1-bd2e-427d-bd69-f74acdd58f8e None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:35.694981 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982ddc1-bd2e-427d-bd69-f74acdd58f8e None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:35.696626 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982ddc1-bd2e-427d-bd69-f74acdd58f8e None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:35.698978 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 61/122] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:35 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:35.699873 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982ddc1-bd2e-427d-bd69-f74acdd58f8e None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:35.731604 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:35.739192 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cd160-dfbc-4c3f-801d-1cdef096a4f4 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:35.783513 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2892993-a1db-4e2e-b6c0-1075e6bb0410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:35.785384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2892993-a1db-4e2e-b6c0-1075e6bb0410 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:35.785948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2892993-a1db-4e2e-b6c0-1075e6bb0410 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:35.786371 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2892993-a1db-4e2e-b6c0-1075e6bb0410 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:35.801360 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2892993-a1db-4e2e-b6c0-1075e6bb0410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-a2892993-a1db-4e2e-b6c0-1075e6bb0410 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:35.808677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:35.809712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:35.810645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:35.810645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:35.810645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:35.810645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:35.810645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:35.810645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:35.810645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:35.810645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:35.810645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:35.810645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:35.810645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:49:35.810645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:35.812637 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 62/123] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:49:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:35.818934 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2892993-a1db-4e2e-b6c0-1075e6bb0410 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:35.861326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982ddc1-bd2e-427d-bd69-f74acdd58f8e None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:35.910219 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8d330-099b-4b5d-b58e-87c9d98fe490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:35.911333 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8d330-099b-4b5d-b58e-87c9d98fe490 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:35.911714 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8d330-099b-4b5d-b58e-87c9d98fe490 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:35.912001 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8d330-099b-4b5d-b58e-87c9d98fe490 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:35.912692 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8d330-099b-4b5d-b58e-87c9d98fe490 None admin] RBAC: Adding query filter params (name=member) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:35.913065 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8d330-099b-4b5d-b58e-87c9d98fe490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:35.915305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8d330-099b-4b5d-b58e-87c9d98fe490 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:35.927393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 62/124] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:49:35 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:35.928085 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8d330-099b-4b5d-b58e-87c9d98fe490 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:35.945114 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2892993-a1db-4e2e-b6c0-1075e6bb0410 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:35.972249 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:35.992649 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c739579-b2d6-4216-b236-615a067f781a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:35.993706 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c739579-b2d6-4216-b236-615a067f781a None admin] REQUEST_METHOD: `PUT` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:35.994190 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c739579-b2d6-4216-b236-615a067f781a None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:35.994662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c739579-b2d6-4216-b236-615a067f781a None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2/users/5579ecb3986c47e1b18c2e33e293c21b/roles/e73a8fc0684c4f6083a71ea9a85c7298` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:35.996885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c739579-b2d6-4216-b236-615a067f781a None admin] RBAC: Authorizing `identity:create_grant(project_id=bc381ac268c74ac7aac2f833ee1437e2, user_id=5579ecb3986c47e1b18c2e33e293c21b, role_id=e73a8fc0684c4f6083a71ea9a85c7298)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:35.998576 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c739579-b2d6-4216-b236-615a067f781a None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:36.061065 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8d330-099b-4b5d-b58e-87c9d98fe490 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:36.080537 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 63/125] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:49:35 2022] PUT /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2/users/5579ecb3986c47e1b18c2e33e293c21b/roles/e73a8fc0684c4f6083a71ea9a85c7298 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:49:36.082134 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c739579-b2d6-4216-b236-615a067f781a None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:36.104139 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:36.111535 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d8345-f40c-4616-bf5e-0e8124640f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:36.113913 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d8345-f40c-4616-bf5e-0e8124640f14 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:36.115139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d8345-f40c-4616-bf5e-0e8124640f14 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:36.115386 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d8345-f40c-4616-bf5e-0e8124640f14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:36.141456 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d8345-f40c-4616-bf5e-0e8124640f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-489d8345-f40c-4616-bf5e-0e8124640f14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:36.158880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:36.159823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:36.160577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:36.160577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:36.160577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:36.160577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:36.160577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:36.160577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:36.160577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:36.160577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:36.160577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:36.160577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:36.160577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:36.160577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:49:36.164442 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 63/126] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:36.164442 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d8345-f40c-4616-bf5e-0e8124640f14 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:36.254566 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c739579-b2d6-4216-b236-615a067f781a None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:36.331530 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e7c7f-11c3-4321-bf98-a891fae2884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:36.332171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e7c7f-11c3-4321-bf98-a891fae2884f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:36.332458 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e7c7f-11c3-4321-bf98-a891fae2884f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:36.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e7c7f-11c3-4321-bf98-a891fae2884f None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:36.333436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e7c7f-11c3-4321-bf98-a891fae2884f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:36.335593 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e7c7f-11c3-4321-bf98-a891fae2884f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:36.339635 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e7c7f-11c3-4321-bf98-a891fae2884f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:36.357343 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 64/127] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:49:36 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:36.358517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e7c7f-11c3-4321-bf98-a891fae2884f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:36.373275 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:36.393402 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d8345-f40c-4616-bf5e-0e8124640f14 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:36.436792 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848fe6e-32a4-4750-9a9a-2e13ef6d2144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:36.438061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848fe6e-32a4-4750-9a9a-2e13ef6d2144 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:36.438529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848fe6e-32a4-4750-9a9a-2e13ef6d2144 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:36.438988 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848fe6e-32a4-4750-9a9a-2e13ef6d2144 None admin] PATH_INFO: `/v3/users/ee496f6834d34c428eca652ff60963ba` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:36.440386 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848fe6e-32a4-4750-9a9a-2e13ef6d2144 None admin] RBAC: Authorizing `identity:get_user(user_id=ee496f6834d34c428eca652ff60963ba)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:36.442037 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848fe6e-32a4-4750-9a9a-2e13ef6d2144 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:36.444212 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 64/128] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:36 2022] GET /identity/v3/users/ee496f6834d34c428eca652ff60963ba => generated 276 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:36.445246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848fe6e-32a4-4750-9a9a-2e13ef6d2144 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:36.463934 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:36.492720 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e7c7f-11c3-4321-bf98-a891fae2884f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:36.550859 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccedadf-0036-4209-8f9d-d9d1751c25ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:36.551984 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccedadf-0036-4209-8f9d-d9d1751c25ad None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:36.552493 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccedadf-0036-4209-8f9d-d9d1751c25ad None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:36.552919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccedadf-0036-4209-8f9d-d9d1751c25ad None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:36.553764 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccedadf-0036-4209-8f9d-d9d1751c25ad None admin] RBAC: Adding query filter params (name=member) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:36.554228 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccedadf-0036-4209-8f9d-d9d1751c25ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:36.555986 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccedadf-0036-4209-8f9d-d9d1751c25ad None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:36.565132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848fe6e-32a4-4750-9a9a-2e13ef6d2144 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:36.566540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 65/129] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:49:36 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:36.570513 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccedadf-0036-4209-8f9d-d9d1751c25ad None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:36.619879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc40f3e-ea8b-473f-a8f4-51d1604aba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:36.621161 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc40f3e-ea8b-473f-a8f4-51d1604aba27 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:36.621779 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc40f3e-ea8b-473f-a8f4-51d1604aba27 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:36.622368 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc40f3e-ea8b-473f-a8f4-51d1604aba27 None admin] PATH_INFO: `/v3/users/ee496f6834d34c428eca652ff60963ba` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:36.624069 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc40f3e-ea8b-473f-a8f4-51d1604aba27 None admin] RBAC: Authorizing `identity:get_user(user_id=ee496f6834d34c428eca652ff60963ba)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:36.626804 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc40f3e-ea8b-473f-a8f4-51d1604aba27 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:36.629614 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 65/130] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:36 2022] GET /identity/v3/users/ee496f6834d34c428eca652ff60963ba => generated 276 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:36.631292 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc40f3e-ea8b-473f-a8f4-51d1604aba27 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:36.723377 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:36.835551 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccedadf-0036-4209-8f9d-d9d1751c25ad None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:36.915277 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc40f3e-ea8b-473f-a8f4-51d1604aba27 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:36.919239 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980a670-90a3-4de2-b6c1-e70a85a63995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:36.921052 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980a670-90a3-4de2-b6c1-e70a85a63995 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:36.921337 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980a670-90a3-4de2-b6c1-e70a85a63995 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:36.922274 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980a670-90a3-4de2-b6c1-e70a85a63995 None admin] PATH_INFO: `/v3/projects/21c7a35fa5c645109701347bd9cf0677` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:36.926989 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980a670-90a3-4de2-b6c1-e70a85a63995 None admin] RBAC: Authorizing `identity:get_project(project_id=21c7a35fa5c645109701347bd9cf0677)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:36.928544 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980a670-90a3-4de2-b6c1-e70a85a63995 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:36.930403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 66/131] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:36 2022] GET /identity/v3/projects/21c7a35fa5c645109701347bd9cf0677 => generated 313 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:36.931306 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980a670-90a3-4de2-b6c1-e70a85a63995 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:36.951280 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:36.995675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687f2cf-d7d9-42c9-a684-3304d3949695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:36.996821 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687f2cf-d7d9-42c9-a684-3304d3949695 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:36.997312 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687f2cf-d7d9-42c9-a684-3304d3949695 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:36.997876 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687f2cf-d7d9-42c9-a684-3304d3949695 None admin] PATH_INFO: `/v3/users/ee496f6834d34c428eca652ff60963ba` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:36.999592 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687f2cf-d7d9-42c9-a684-3304d3949695 None admin] RBAC: Authorizing `identity:get_user(user_id=ee496f6834d34c428eca652ff60963ba)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:37.001427 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687f2cf-d7d9-42c9-a684-3304d3949695 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:37.004001 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 66/132] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:36 2022] GET /identity/v3/users/ee496f6834d34c428eca652ff60963ba => generated 276 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:37.005133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687f2cf-d7d9-42c9-a684-3304d3949695 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:37.076009 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980a670-90a3-4de2-b6c1-e70a85a63995 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:37.142294 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd0250-3929-48c1-9327-e56ae5a24023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:37.143914 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd0250-3929-48c1-9327-e56ae5a24023 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:37.144218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd0250-3929-48c1-9327-e56ae5a24023 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:37.144571 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd0250-3929-48c1-9327-e56ae5a24023 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:37.148374 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd0250-3929-48c1-9327-e56ae5a24023 None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:37.149906 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd0250-3929-48c1-9327-e56ae5a24023 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:37.160119 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 67/133] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:36 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:37.161160 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd0250-3929-48c1-9327-e56ae5a24023 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:37.191251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:37.210164 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687f2cf-d7d9-42c9-a684-3304d3949695 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:37.295746 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:37.318386 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd0250-3929-48c1-9327-e56ae5a24023 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:37.319577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c3553-f1b0-49ec-b280-cc6f9bdc5cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:37.320293 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c3553-f1b0-49ec-b280-cc6f9bdc5cfc None admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:37.320576 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c3553-f1b0-49ec-b280-cc6f9bdc5cfc None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:37.320859 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c3553-f1b0-49ec-b280-cc6f9bdc5cfc None admin] PATH_INFO: `/v3/projects/21c7a35fa5c645109701347bd9cf0677/users/ee496f6834d34c428eca652ff60963ba/roles/8acc6a2016c149a0b80cf3c56b5ae91a` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:37.323188 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c3553-f1b0-49ec-b280-cc6f9bdc5cfc None admin] RBAC: Authorizing `identity:create_grant(project_id=21c7a35fa5c645109701347bd9cf0677, user_id=ee496f6834d34c428eca652ff60963ba, role_id=8acc6a2016c149a0b80cf3c56b5ae91a)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:37.324723 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c3553-f1b0-49ec-b280-cc6f9bdc5cfc None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:37.360020 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb25ac-e844-43c1-ab18-344cf02ce31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:37.360758 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb25ac-e844-43c1-ab18-344cf02ce31f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:37.361120 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb25ac-e844-43c1-ab18-344cf02ce31f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:37.361494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb25ac-e844-43c1-ab18-344cf02ce31f None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:37.362685 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb25ac-e844-43c1-ab18-344cf02ce31f None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:37.364202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb25ac-e844-43c1-ab18-344cf02ce31f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:37.366021 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 68/134] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:37 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:37.366571 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb25ac-e844-43c1-ab18-344cf02ce31f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:37.451066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 67/135] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:49:37 2022] PUT /identity/v3/projects/21c7a35fa5c645109701347bd9cf0677/users/ee496f6834d34c428eca652ff60963ba/roles/8acc6a2016c149a0b80cf3c56b5ae91a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:49:37.457408 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd776e3-d724-4603-9612-acf747b705db None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:37.458248 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd776e3-d724-4603-9612-acf747b705db None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:37.458792 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd776e3-d724-4603-9612-acf747b705db None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:37.464462 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 68/136] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:37 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:37.464462 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd776e3-d724-4603-9612-acf747b705db None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:37.486879 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb25ac-e844-43c1-ab18-344cf02ce31f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:37.531697 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4d0d5-9afa-47bd-9524-62a2225c16bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:37.532393 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4d0d5-9afa-47bd-9524-62a2225c16bb None admin] REQUEST_METHOD: `PUT` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:37.534111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4d0d5-9afa-47bd-9524-62a2225c16bb None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:37.534435 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4d0d5-9afa-47bd-9524-62a2225c16bb None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2/users/ee496f6834d34c428eca652ff60963ba/roles/034b8b83b5934694bebbf0e19a81dc15` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:37.538513 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4d0d5-9afa-47bd-9524-62a2225c16bb None admin] RBAC: Authorizing `identity:create_grant(project_id=bc381ac268c74ac7aac2f833ee1437e2, user_id=ee496f6834d34c428eca652ff60963ba, role_id=034b8b83b5934694bebbf0e19a81dc15)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:37.540086 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4d0d5-9afa-47bd-9524-62a2225c16bb None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:37.659692 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 69/137] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:49:37 2022] PUT /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2/users/ee496f6834d34c428eca652ff60963ba/roles/034b8b83b5934694bebbf0e19a81dc15 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:49:37.661056 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b929525-c1a3-4556-a7a3-84155283b4de None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:37.661419 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b929525-c1a3-4556-a7a3-84155283b4de None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:37.661659 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b929525-c1a3-4556-a7a3-84155283b4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:37.675540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd776e3-d724-4603-9612-acf747b705db None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:37.676792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:37.706970 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-0b929525-c1a3-4556-a7a3-84155283b4de None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:37.706970 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-0b929525-c1a3-4556-a7a3-84155283b4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:37.751158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c84ef-8634-4329-a465-915df7586589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:37.753410 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c84ef-8634-4329-a465-915df7586589 None admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:37.754179 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c84ef-8634-4329-a465-915df7586589 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:37.755003 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c84ef-8634-4329-a465-915df7586589 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2/users/ee496f6834d34c428eca652ff60963ba/roles/8acc6a2016c149a0b80cf3c56b5ae91a` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:37.759099 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c84ef-8634-4329-a465-915df7586589 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc381ac268c74ac7aac2f833ee1437e2, user_id=ee496f6834d34c428eca652ff60963ba, role_id=8acc6a2016c149a0b80cf3c56b5ae91a)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:37.762193 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c84ef-8634-4329-a465-915df7586589 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:37.830225 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 70/138] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:37.856692 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 69/139] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:49:37 2022] PUT /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2/users/ee496f6834d34c428eca652ff60963ba/roles/8acc6a2016c149a0b80cf3c56b5ae91a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:49:38.070905 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde9862-d430-4681-83fc-113a9ca2ac9b None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:38.071438 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde9862-d430-4681-83fc-113a9ca2ac9b None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:38.071559 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde9862-d430-4681-83fc-113a9ca2ac9b None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:38.073166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 71/140] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:38.089072 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a68ea0-6c84-489c-9282-3e09a7bf3c39 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:38.089756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a68ea0-6c84-489c-9282-3e09a7bf3c39 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:38.090372 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a68ea0-6c84-489c-9282-3e09a7bf3c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:38.118604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-e8a68ea0-6c84-489c-9282-3e09a7bf3c39 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:38.120526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-e8a68ea0-6c84-489c-9282-3e09a7bf3c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:38.133669 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:38.225588 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 70/141] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:38.265244 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde9862-d430-4681-83fc-113a9ca2ac9b None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:38.421212 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde9862-d430-4681-83fc-113a9ca2ac9b None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:38.465098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:38.472116 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7570f63-a467-4b18-9fb1-dfdd8071f444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:38.473202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7570f63-a467-4b18-9fb1-dfdd8071f444 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:38.473648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7570f63-a467-4b18-9fb1-dfdd8071f444 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:38.474081 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7570f63-a467-4b18-9fb1-dfdd8071f444 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:38.476871 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7570f63-a467-4b18-9fb1-dfdd8071f444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:38.477238 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7570f63-a467-4b18-9fb1-dfdd8071f444 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:38.478876 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 72/142] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:49:38 2022] GET /identity/v3/domains/default => generated 200 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:38.489471 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a68ea0-6c84-489c-9282-3e09a7bf3c39 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:38.642884 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a68ea0-6c84-489c-9282-3e09a7bf3c39 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:38.692489 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb3cfc-0755-4a18-9e95-5681bcc21fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:38.693038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb3cfc-0755-4a18-9e95-5681bcc21fc3 None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:38.694859 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb3cfc-0755-4a18-9e95-5681bcc21fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:38.694859 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb3cfc-0755-4a18-9e95-5681bcc21fc3 None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:38.694859 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb3cfc-0755-4a18-9e95-5681bcc21fc3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:38.695912 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb3cfc-0755-4a18-9e95-5681bcc21fc3 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:38.800946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:38.808567 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 71/143] 10.222.0.121 () {60 vars in 1137 bytes} [Fri Aug 26 00:49:38 2022] POST /identity/v3/users => generated 284 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:49:38.866742 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7570f63-a467-4b18-9fb1-dfdd8071f444 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:39.006630 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7570f63-a467-4b18-9fb1-dfdd8071f444 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:39.059480 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989541f0-8dbf-4c4a-a0e0-c5fd014d795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:39.060131 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989541f0-8dbf-4c4a-a0e0-c5fd014d795e None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:39.060408 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989541f0-8dbf-4c4a-a0e0-c5fd014d795e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:39.060679 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989541f0-8dbf-4c4a-a0e0-c5fd014d795e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:39.083987 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989541f0-8dbf-4c4a-a0e0-c5fd014d795e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-989541f0-8dbf-4c4a-a0e0-c5fd014d795e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:39.088895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:39.094083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:39.094884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:39.094884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:39.094884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:39.094884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:39.094884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:39.094884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:39.094884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:39.094884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:39.094884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:39.094884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:39.094884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:49:39.094884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:39.094884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 73/144] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:39.096783 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb3cfc-0755-4a18-9e95-5681bcc21fc3 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:39.293431 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb3cfc-0755-4a18-9e95-5681bcc21fc3 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:39.341620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be807a-ee34-43b9-8b4a-6eddf6d8de3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:39.342248 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be807a-ee34-43b9-8b4a-6eddf6d8de3f None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:39.342529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be807a-ee34-43b9-8b4a-6eddf6d8de3f None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:39.342805 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be807a-ee34-43b9-8b4a-6eddf6d8de3f None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:39.343567 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be807a-ee34-43b9-8b4a-6eddf6d8de3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:39.343870 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be807a-ee34-43b9-8b4a-6eddf6d8de3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:39.345277 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be807a-ee34-43b9-8b4a-6eddf6d8de3f None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:39.355445 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 72/145] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:49:39 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:39.363929 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989541f0-8dbf-4c4a-a0e0-c5fd014d795e None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:39.440642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:39.485913 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989541f0-8dbf-4c4a-a0e0-c5fd014d795e None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:39.530068 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacfc97-8eb9-44ca-8779-440925d63cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:39.531018 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacfc97-8eb9-44ca-8779-440925d63cdd None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:39.531434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacfc97-8eb9-44ca-8779-440925d63cdd None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:39.531865 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacfc97-8eb9-44ca-8779-440925d63cdd None admin] PATH_INFO: `/v3/users/1d64cfc4d5584597927d6e4b566654f4` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:39.535898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdacfc97-8eb9-44ca-8779-440925d63cdd None admin] RBAC: Authorizing `identity:get_user(user_id=1d64cfc4d5584597927d6e4b566654f4)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:39.537633 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdacfc97-8eb9-44ca-8779-440925d63cdd None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:39.539790 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 74/146] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:39 2022] GET /identity/v3/users/1d64cfc4d5584597927d6e4b566654f4 => generated 290 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:39.545168 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be807a-ee34-43b9-8b4a-6eddf6d8de3f None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:39.603603 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd254452-0cd6-47cf-9fde-fab2ad015bc3 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:39.604135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd254452-0cd6-47cf-9fde-fab2ad015bc3 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:39.604747 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd254452-0cd6-47cf-9fde-fab2ad015bc3 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:39.607043 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 75/147] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:39 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:49:39.614570 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004658f-1f85-4b4a-9c9e-861c7216cf10 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:39.615091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004658f-1f85-4b4a-9c9e-861c7216cf10 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:39.615525 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004658f-1f85-4b4a-9c9e-861c7216cf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:39.652294 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-c004658f-1f85-4b4a-9c9e-861c7216cf10 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:39.653515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-c004658f-1f85-4b4a-9c9e-861c7216cf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:39.676025 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:39.745752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be807a-ee34-43b9-8b4a-6eddf6d8de3f None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:39.789163 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c6160-a8c8-46c8-bc26-f494918a98c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:39.789837 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c6160-a8c8-46c8-bc26-f494918a98c2 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:39.790087 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c6160-a8c8-46c8-bc26-f494918a98c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:39.790360 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c6160-a8c8-46c8-bc26-f494918a98c2 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:39.793746 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c6160-a8c8-46c8-bc26-f494918a98c2 None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:39.798943 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c6160-a8c8-46c8-bc26-f494918a98c2 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:39.798943 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 73/148] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:39 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:39.804425 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c6160-a8c8-46c8-bc26-f494918a98c2 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:39.838198 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 76/149] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:39.931686 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c6160-a8c8-46c8-bc26-f494918a98c2 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:39.963514 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:39.972952 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bc054-2dce-4836-ab6e-f11ea668c3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:39.973604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bc054-2dce-4836-ab6e-f11ea668c3f2 None admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:39.973885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bc054-2dce-4836-ab6e-f11ea668c3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:39.974162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bc054-2dce-4836-ab6e-f11ea668c3f2 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2/users/1d64cfc4d5584597927d6e4b566654f4/roles/c89a332a133c4bc7b2a9a1ba7b599dd8` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:39.976338 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bc054-2dce-4836-ab6e-f11ea668c3f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc381ac268c74ac7aac2f833ee1437e2, user_id=1d64cfc4d5584597927d6e4b566654f4, role_id=c89a332a133c4bc7b2a9a1ba7b599dd8)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:39.979868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bc054-2dce-4836-ab6e-f11ea668c3f2 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:40.134180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 74/150] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:49:39 2022] PUT /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2/users/1d64cfc4d5584597927d6e4b566654f4/roles/c89a332a133c4bc7b2a9a1ba7b599dd8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:49:40.330310 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004658f-1f85-4b4a-9c9e-861c7216cf10 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:40.475304 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:40.573886 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004658f-1f85-4b4a-9c9e-861c7216cf10 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:40.651818 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c28c12-637d-46db-8df8-a896e00fcd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:40.652919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c28c12-637d-46db-8df8-a896e00fcd9d None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:40.653413 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c28c12-637d-46db-8df8-a896e00fcd9d None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:40.653884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c28c12-637d-46db-8df8-a896e00fcd9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:40.680200 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c28c12-637d-46db-8df8-a896e00fcd9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-37c28c12-637d-46db-8df8-a896e00fcd9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:40.689975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:40.690902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:40.691648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:40.691648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:40.691648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:40.691648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:40.691648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:40.691648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:40.691648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:40.691648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:40.691648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:40.691648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:40.691648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:40.691648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:40.692315 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 77/151] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:49:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:40.699756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bc054-2dce-4836-ab6e-f11ea668c3f2 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:40.919564 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bc054-2dce-4836-ab6e-f11ea668c3f2 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:40.956972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c88af-56ad-4786-837d-24a9e5dd48d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:40.957599 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c88af-56ad-4786-837d-24a9e5dd48d6 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:40.957879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c88af-56ad-4786-837d-24a9e5dd48d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:40.958159 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c88af-56ad-4786-837d-24a9e5dd48d6 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:40.958848 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c88af-56ad-4786-837d-24a9e5dd48d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:40.959192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c88af-56ad-4786-837d-24a9e5dd48d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:40.960596 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c88af-56ad-4786-837d-24a9e5dd48d6 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:40.975076 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 75/152] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:40 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:40.997833 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c28c12-637d-46db-8df8-a896e00fcd9d None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:41.138380 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c28c12-637d-46db-8df8-a896e00fcd9d None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:41.167434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:41.189270 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d18c19-4ed0-4d8a-952a-ef8b73af2c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:41.189834 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d18c19-4ed0-4d8a-952a-ef8b73af2c93 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:41.190119 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d18c19-4ed0-4d8a-952a-ef8b73af2c93 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:41.190394 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d18c19-4ed0-4d8a-952a-ef8b73af2c93 None admin] PATH_INFO: `/v3/users/5579ecb3986c47e1b18c2e33e293c21b` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:41.195838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d18c19-4ed0-4d8a-952a-ef8b73af2c93 None admin] RBAC: Authorizing `identity:get_user(user_id=5579ecb3986c47e1b18c2e33e293c21b)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:41.197641 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d18c19-4ed0-4d8a-952a-ef8b73af2c93 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:41.199519 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 78/153] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:40 2022] GET /identity/v3/users/5579ecb3986c47e1b18c2e33e293c21b => generated 248 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:41.206609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c88af-56ad-4786-837d-24a9e5dd48d6 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:41.266527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:41.345041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c88af-56ad-4786-837d-24a9e5dd48d6 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:41.402837 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df0f31-b937-4603-a7a9-10de0e2e0e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:41.403462 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df0f31-b937-4603-a7a9-10de0e2e0e9b None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:41.403742 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df0f31-b937-4603-a7a9-10de0e2e0e9b None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:41.404016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df0f31-b937-4603-a7a9-10de0e2e0e9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:41.491168 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df0f31-b937-4603-a7a9-10de0e2e0e9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:41.492603 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df0f31-b937-4603-a7a9-10de0e2e0e9b None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:41.566543 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:41.623072 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 76/154] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:41 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:49:41.629803 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d18c19-4ed0-4d8a-952a-ef8b73af2c93 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:41.756812 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d18c19-4ed0-4d8a-952a-ef8b73af2c93 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:41.803319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda9abf-3059-4678-8f65-8f0aaf998c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:41.804274 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda9abf-3059-4678-8f65-8f0aaf998c74 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:41.804618 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda9abf-3059-4678-8f65-8f0aaf998c74 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:41.804898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda9abf-3059-4678-8f65-8f0aaf998c74 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:41.806266 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda9abf-3059-4678-8f65-8f0aaf998c74 None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:41.807956 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda9abf-3059-4678-8f65-8f0aaf998c74 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:41.809972 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 79/155] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:41 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:41.816798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df0f31-b937-4603-a7a9-10de0e2e0e9b None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:41.952217 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df0f31-b937-4603-a7a9-10de0e2e0e9b None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:42.008662 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76311f8-1d8a-4513-8a96-0eb75f4d2ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:42.009212 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76311f8-1d8a-4513-8a96-0eb75f4d2ec3 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:42.009492 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76311f8-1d8a-4513-8a96-0eb75f4d2ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:42.009779 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76311f8-1d8a-4513-8a96-0eb75f4d2ec3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:42.010500 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76311f8-1d8a-4513-8a96-0eb75f4d2ec3 None admin] RBAC: Adding query filter params (role.id=e73a8fc0684c4f6083a71ea9a85c7298, scope.project.id=bc381ac268c74ac7aac2f833ee1437e2, user.id=5579ecb3986c47e1b18c2e33e293c21b) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:42.010804 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76311f8-1d8a-4513-8a96-0eb75f4d2ec3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:42.012329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76311f8-1d8a-4513-8a96-0eb75f4d2ec3 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:42.027865 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 77/156] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:41 2022] GET /identity/v3/role_assignments?user.id=5579ecb3986c47e1b18c2e33e293c21b&scope.project.id=bc381ac268c74ac7aac2f833ee1437e2&role.id=e73a8fc0684c4f6083a71ea9a85c7298 => generated 610 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:42.230806 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eab0e3-2ff1-45f7-b066-4ab070c48147 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:42.231232 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eab0e3-2ff1-45f7-b066-4ab070c48147 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:42.231406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eab0e3-2ff1-45f7-b066-4ab070c48147 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:42.233079 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 80/157] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:42.239876 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163803b-d76d-4e61-b5c4-09ce595965ee None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:42.240244 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163803b-d76d-4e61-b5c4-09ce595965ee None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:42.240450 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163803b-d76d-4e61-b5c4-09ce595965ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:42.268858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-8163803b-d76d-4e61-b5c4-09ce595965ee None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:42.270847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-8163803b-d76d-4e61-b5c4-09ce595965ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:42.284394 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:42.412639 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 78/158] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:42.719526 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2cc93-51c1-4645-90b1-cdb4f1255eb4 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:42.720044 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2cc93-51c1-4645-90b1-cdb4f1255eb4 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:42.720044 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2cc93-51c1-4645-90b1-cdb4f1255eb4 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:42.721403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 81/159] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:42.731721 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aece6b1-ac79-41c3-9fe9-ad6143036997 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:42.732100 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aece6b1-ac79-41c3-9fe9-ad6143036997 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:42.732570 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aece6b1-ac79-41c3-9fe9-ad6143036997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:42.760908 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-7aece6b1-ac79-41c3-9fe9-ad6143036997 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:42.762137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-7aece6b1-ac79-41c3-9fe9-ad6143036997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:42.868358 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 79/160] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:42.940361 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61015fd6-957f-483f-a4d7-f0307c70f705 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:42.940770 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61015fd6-957f-483f-a4d7-f0307c70f705 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:42.940920 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61015fd6-957f-483f-a4d7-f0307c70f705 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:42.942638 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 82/161] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:49:42.948401 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffaf497-a2be-4f66-8a70-e1f5c383f414 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:42.948749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffaf497-a2be-4f66-8a70-e1f5c383f414 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:42.948996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffaf497-a2be-4f66-8a70-e1f5c383f414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:42.977459 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-bffaf497-a2be-4f66-8a70-e1f5c383f414 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:42.978623 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-bffaf497-a2be-4f66-8a70-e1f5c383f414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:43.086798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 80/162] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:49:43.104498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61015fd6-957f-483f-a4d7-f0307c70f705 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:43.221287 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:43.287035 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61015fd6-957f-483f-a4d7-f0307c70f705 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:43.343691 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a808f-a564-4c76-b05c-70d45e6e4133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:43.344406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a808f-a564-4c76-b05c-70d45e6e4133 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:43.344694 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a808f-a564-4c76-b05c-70d45e6e4133 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:43.344979 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a808f-a564-4c76-b05c-70d45e6e4133 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:43.358832 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a808f-a564-4c76-b05c-70d45e6e4133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-634a808f-a564-4c76-b05c-70d45e6e4133 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:43.364277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:43.365135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:43.365885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:43.365885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:43.365885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:43.365885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:43.365885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:43.365885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:43.365885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:43.365885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:43.365885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:43.365885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:43.365885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:49:43.365885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:43.366466 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 83/163] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:49:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:43.371293 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffaf497-a2be-4f66-8a70-e1f5c383f414 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:43.384163 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:43.402345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a808f-a564-4c76-b05c-70d45e6e4133 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:43.573650 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffaf497-a2be-4f66-8a70-e1f5c383f414 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:43.653374 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a808f-a564-4c76-b05c-70d45e6e4133 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:43.668924 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055589c-d49f-4f4d-8aba-d90f75070ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:43.669979 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055589c-d49f-4f4d-8aba-d90f75070ad2 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:43.670449 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055589c-d49f-4f4d-8aba-d90f75070ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:43.671013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055589c-d49f-4f4d-8aba-d90f75070ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:43.672229 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055589c-d49f-4f4d-8aba-d90f75070ad2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:43.672718 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055589c-d49f-4f4d-8aba-d90f75070ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:43.673645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:43.675177 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055589c-d49f-4f4d-8aba-d90f75070ad2 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:43.707736 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e896f84-79d1-499c-83bc-08ac52f89acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:43.707940 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 81/164] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:49:43 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:43.708400 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e896f84-79d1-499c-83bc-08ac52f89acc None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:43.708688 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e896f84-79d1-499c-83bc-08ac52f89acc None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:43.708970 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e896f84-79d1-499c-83bc-08ac52f89acc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:43.714849 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055589c-d49f-4f4d-8aba-d90f75070ad2 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:43.744034 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e896f84-79d1-499c-83bc-08ac52f89acc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-4e896f84-79d1-499c-83bc-08ac52f89acc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:43.749077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:43.749996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:43.750771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:43.750771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:43.750771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:43.750771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:43.750771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:43.750771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:43.750771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:43.750771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:43.750771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:43.750771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:43.750771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:43.750771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:43.750771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 84/165] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:43.759630 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e896f84-79d1-499c-83bc-08ac52f89acc None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:43.928578 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:44.042501 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055589c-d49f-4f4d-8aba-d90f75070ad2 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:44.051556 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e896f84-79d1-499c-83bc-08ac52f89acc None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:44.119565 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb4cc8-aa72-4106-95f4-aca1ccbf0e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:44.120588 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb4cc8-aa72-4106-95f4-aca1ccbf0e73 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:44.121097 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb4cc8-aa72-4106-95f4-aca1ccbf0e73 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:44.121567 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb4cc8-aa72-4106-95f4-aca1ccbf0e73 None admin] PATH_INFO: `/v3/users/ee496f6834d34c428eca652ff60963ba` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:44.124755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb4cc8-aa72-4106-95f4-aca1ccbf0e73 None admin] RBAC: Authorizing `identity:get_user(user_id=ee496f6834d34c428eca652ff60963ba)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:44.126864 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb4cc8-aa72-4106-95f4-aca1ccbf0e73 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:44.129111 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 82/166] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:43 2022] GET /identity/v3/users/ee496f6834d34c428eca652ff60963ba => generated 276 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:44.130118 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb4cc8-aa72-4106-95f4-aca1ccbf0e73 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:44.162848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc682046-4f1e-44bf-a570-75a4d3869fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:44.162848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc682046-4f1e-44bf-a570-75a4d3869fb4 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:44.162848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc682046-4f1e-44bf-a570-75a4d3869fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:44.162848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc682046-4f1e-44bf-a570-75a4d3869fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:44.163300 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc682046-4f1e-44bf-a570-75a4d3869fb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:44.163300 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc682046-4f1e-44bf-a570-75a4d3869fb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:44.164220 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc682046-4f1e-44bf-a570-75a4d3869fb4 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:44.194660 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 85/167] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:49:43 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:44.194660 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc682046-4f1e-44bf-a570-75a4d3869fb4 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:44.302704 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb4cc8-aa72-4106-95f4-aca1ccbf0e73 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:44.321169 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:44.359018 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a8aa8-d03d-4c8b-9855-502314ae2fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:44.360906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a8aa8-d03d-4c8b-9855-502314ae2fa2 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:44.361355 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a8aa8-d03d-4c8b-9855-502314ae2fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:44.365909 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a8aa8-d03d-4c8b-9855-502314ae2fa2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:44.368587 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:44.393914 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a8aa8-d03d-4c8b-9855-502314ae2fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-c39a8aa8-d03d-4c8b-9855-502314ae2fa2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:44.399899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:44.401049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:44.402070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:44.402070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:44.402070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:44.402070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:44.402070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:44.402070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:44.402070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:44.402070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:44.402070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:44.402070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:44.402070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:44.402070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:49:44.412436 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 83/168] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:44.413529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a8aa8-d03d-4c8b-9855-502314ae2fa2 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:44.472067 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc682046-4f1e-44bf-a570-75a4d3869fb4 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:44.529765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5391ea-178e-432b-8809-47ed058567ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:44.530461 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5391ea-178e-432b-8809-47ed058567ea None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:44.530745 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5391ea-178e-432b-8809-47ed058567ea None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:44.531047 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5391ea-178e-432b-8809-47ed058567ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:44.637206 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a8aa8-d03d-4c8b-9855-502314ae2fa2 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:44.680700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5391ea-178e-432b-8809-47ed058567ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:44.682217 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5391ea-178e-432b-8809-47ed058567ea None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:44.739374 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:44.747684 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de2d36-793e-40ef-97b9-00501fe3db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:44.748355 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de2d36-793e-40ef-97b9-00501fe3db65 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:44.752525 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de2d36-793e-40ef-97b9-00501fe3db65 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:44.752525 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de2d36-793e-40ef-97b9-00501fe3db65 None admin] PATH_INFO: `/v3/users/ee496f6834d34c428eca652ff60963ba` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:44.755697 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de2d36-793e-40ef-97b9-00501fe3db65 None admin] RBAC: Authorizing `identity:get_user(user_id=ee496f6834d34c428eca652ff60963ba)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:44.757238 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de2d36-793e-40ef-97b9-00501fe3db65 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:44.759294 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 84/169] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:44 2022] GET /identity/v3/users/ee496f6834d34c428eca652ff60963ba => generated 276 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:44.760093 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de2d36-793e-40ef-97b9-00501fe3db65 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:44.847304 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 86/170] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:44 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:49:44.849650 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5391ea-178e-432b-8809-47ed058567ea None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:44.880853 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:45.007004 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de2d36-793e-40ef-97b9-00501fe3db65 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:45.019117 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5391ea-178e-432b-8809-47ed058567ea None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:45.054692 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda869b-593c-4e4e-9fe6-61f0c7bddf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:45.055352 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda869b-593c-4e4e-9fe6-61f0c7bddf14 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:45.055736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda869b-593c-4e4e-9fe6-61f0c7bddf14 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:45.056013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda869b-593c-4e4e-9fe6-61f0c7bddf14 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:45.056771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda869b-593c-4e4e-9fe6-61f0c7bddf14 None admin] RBAC: Adding query filter params (name=member) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:45.057341 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda869b-593c-4e4e-9fe6-61f0c7bddf14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:45.059035 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda869b-593c-4e4e-9fe6-61f0c7bddf14 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:45.061673 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10cd26-b2d8-4d03-a194-14b850c9c8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:45.062280 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10cd26-b2d8-4d03-a194-14b850c9c8d7 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:45.062707 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10cd26-b2d8-4d03-a194-14b850c9c8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:45.063163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10cd26-b2d8-4d03-a194-14b850c9c8d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:45.067226 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:45.070482 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 85/171] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:49:44 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:45.075840 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda869b-593c-4e4e-9fe6-61f0c7bddf14 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:45.143662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10cd26-b2d8-4d03-a194-14b850c9c8d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:45.145301 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10cd26-b2d8-4d03-a194-14b850c9c8d7 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:45.208587 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda869b-593c-4e4e-9fe6-61f0c7bddf14 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:45.239729 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:45.254443 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103d9d7-8e51-4348-b154-a8ce75ba78b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:45.255720 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103d9d7-8e51-4348-b154-a8ce75ba78b6 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:45.256192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103d9d7-8e51-4348-b154-a8ce75ba78b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:45.256670 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103d9d7-8e51-4348-b154-a8ce75ba78b6 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:45.258237 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103d9d7-8e51-4348-b154-a8ce75ba78b6 None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:45.259517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 87/172] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:44 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:49:45.260271 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103d9d7-8e51-4348-b154-a8ce75ba78b6 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:45.260825 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77074b-71fd-4af3-b99b-a9a0a57e722b None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:45.261108 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77074b-71fd-4af3-b99b-a9a0a57e722b None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:45.261381 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77074b-71fd-4af3-b99b-a9a0a57e722b None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:45.262652 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 88/173] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:45.263149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 86/174] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:45 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:45.265395 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ac4a2-4bd6-4715-ae2b-2608507d94ed None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:45.265917 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ac4a2-4bd6-4715-ae2b-2608507d94ed None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:45.266542 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ac4a2-4bd6-4715-ae2b-2608507d94ed None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:45.268475 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 87/175] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:45 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:45.270003 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77074b-71fd-4af3-b99b-a9a0a57e722b None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:45.270749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ac4a2-4bd6-4715-ae2b-2608507d94ed None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:45.326007 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:45.419080 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77074b-71fd-4af3-b99b-a9a0a57e722b None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:45.421404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ac4a2-4bd6-4715-ae2b-2608507d94ed None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:45.464118 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1196f6-77a8-44ae-8386-60e82e7f7383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:45.464748 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1196f6-77a8-44ae-8386-60e82e7f7383 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:45.465024 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1196f6-77a8-44ae-8386-60e82e7f7383 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:45.465298 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1196f6-77a8-44ae-8386-60e82e7f7383 None admin] PATH_INFO: `/v3/users/ee496f6834d34c428eca652ff60963ba` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:45.466481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1196f6-77a8-44ae-8386-60e82e7f7383 None admin] RBAC: Authorizing `identity:get_user(user_id=ee496f6834d34c428eca652ff60963ba)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:45.468054 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1196f6-77a8-44ae-8386-60e82e7f7383 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:45.469520 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb944ea-5273-4e33-840a-9611867cb44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:45.469638 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 89/176] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:45 2022] GET /identity/v3/users/ee496f6834d34c428eca652ff60963ba => generated 276 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:45.470172 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb944ea-5273-4e33-840a-9611867cb44b None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:45.470451 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb944ea-5273-4e33-840a-9611867cb44b None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:45.470746 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb944ea-5273-4e33-840a-9611867cb44b None admin] PATH_INFO: `/v3/projects/21c7a35fa5c645109701347bd9cf0677` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:45.470897 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e700e04-287a-412b-80dc-33bc583e8b00 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:45.471049 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e700e04-287a-412b-80dc-33bc583e8b00 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:45.471306 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e700e04-287a-412b-80dc-33bc583e8b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:45.471906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb944ea-5273-4e33-840a-9611867cb44b None admin] RBAC: Authorizing `identity:get_project(project_id=21c7a35fa5c645109701347bd9cf0677)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:45.473877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb944ea-5273-4e33-840a-9611867cb44b None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:45.476560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 88/177] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:45 2022] GET /identity/v3/projects/21c7a35fa5c645109701347bd9cf0677 => generated 313 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:45.478135 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892c6b8-a475-4b69-958f-e6f7a3f5013f None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:45.478592 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892c6b8-a475-4b69-958f-e6f7a3f5013f None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:45.479064 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892c6b8-a475-4b69-958f-e6f7a3f5013f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:45.492298 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-5e700e04-287a-412b-80dc-33bc583e8b00 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:45.493513 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-5e700e04-287a-412b-80dc-33bc583e8b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:45.498059 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-0892c6b8-a475-4b69-958f-e6f7a3f5013f None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:45.499885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-0892c6b8-a475-4b69-958f-e6f7a3f5013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:45.557248 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:45.564481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 90/178] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:45.567777 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e700e04-287a-412b-80dc-33bc583e8b00 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:45.569385 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 89/179] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:45.569943 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0a785-2296-499e-a7a0-7d018a8a26fa None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:45.570237 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0a785-2296-499e-a7a0-7d018a8a26fa None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:45.570519 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0a785-2296-499e-a7a0-7d018a8a26fa None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:45.572346 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 90/180] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:45.577485 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdee75-9b7c-4a93-87aa-87974549bc02 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:45.577765 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdee75-9b7c-4a93-87aa-87974549bc02 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:45.578044 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdee75-9b7c-4a93-87aa-87974549bc02 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:45.583700 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 91/181] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:45 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:45.583700 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdee75-9b7c-4a93-87aa-87974549bc02 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:45.641618 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:45.722622 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdee75-9b7c-4a93-87aa-87974549bc02 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:45.726681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e700e04-287a-412b-80dc-33bc583e8b00 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:45.760838 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec6b1f-4751-4708-905b-a9891e8cc328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:45.762082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec6b1f-4751-4708-905b-a9891e8cc328 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:45.762684 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec6b1f-4751-4708-905b-a9891e8cc328 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:45.763070 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75788c-88b6-4814-981e-c288c680fb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:45.763525 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec6b1f-4751-4708-905b-a9891e8cc328 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:45.763739 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75788c-88b6-4814-981e-c288c680fb4d None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:45.764014 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75788c-88b6-4814-981e-c288c680fb4d None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:45.764283 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75788c-88b6-4814-981e-c288c680fb4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:45.765128 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75788c-88b6-4814-981e-c288c680fb4d None admin] RBAC: Adding query filter params (role.id=034b8b83b5934694bebbf0e19a81dc15, scope.project.id=bc381ac268c74ac7aac2f833ee1437e2, user.id=ee496f6834d34c428eca652ff60963ba) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:45.765445 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75788c-88b6-4814-981e-c288c680fb4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:45.767037 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75788c-88b6-4814-981e-c288c680fb4d None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:45.774718 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 91/182] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:45 2022] GET /identity/v3/role_assignments?user.id=ee496f6834d34c428eca652ff60963ba&scope.project.id=bc381ac268c74ac7aac2f833ee1437e2&role.id=034b8b83b5934694bebbf0e19a81dc15 => generated 610 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:45.775409 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75788c-88b6-4814-981e-c288c680fb4d None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:45.839992 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:45.856959 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec6b1f-4751-4708-905b-a9891e8cc328 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:45.859097 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec6b1f-4751-4708-905b-a9891e8cc328 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:45.972879 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:45.977520 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75788c-88b6-4814-981e-c288c680fb4d None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:46.018338 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 92/183] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:45 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:49:46.019805 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf165833-f3f0-46aa-ac8e-86ceaae032f0 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:46.019923 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf165833-f3f0-46aa-ac8e-86ceaae032f0 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:46.020160 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf165833-f3f0-46aa-ac8e-86ceaae032f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:46.025705 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262edb7c-4218-4192-b240-9fbe7fa9d7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:46.026378 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262edb7c-4218-4192-b240-9fbe7fa9d7b6 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:46.026729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262edb7c-4218-4192-b240-9fbe7fa9d7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:46.027060 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262edb7c-4218-4192-b240-9fbe7fa9d7b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:46.027821 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262edb7c-4218-4192-b240-9fbe7fa9d7b6 None admin] RBAC: Adding query filter params (role.id=8acc6a2016c149a0b80cf3c56b5ae91a, scope.project.id=21c7a35fa5c645109701347bd9cf0677, user.id=ee496f6834d34c428eca652ff60963ba) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:46.028140 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262edb7c-4218-4192-b240-9fbe7fa9d7b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:46.029623 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262edb7c-4218-4192-b240-9fbe7fa9d7b6 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:46.039183 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 92/184] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:45 2022] GET /identity/v3/role_assignments?user.id=ee496f6834d34c428eca652ff60963ba&scope.project.id=21c7a35fa5c645109701347bd9cf0677&role.id=8acc6a2016c149a0b80cf3c56b5ae91a => generated 610 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:46.041510 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800489e0-f62f-43a7-8a9d-29c6b971f26a None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:46.041912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800489e0-f62f-43a7-8a9d-29c6b971f26a None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:46.042087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800489e0-f62f-43a7-8a9d-29c6b971f26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:46.047710 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-bf165833-f3f0-46aa-ac8e-86ceaae032f0 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:46.049665 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-bf165833-f3f0-46aa-ac8e-86ceaae032f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:46.069976 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-800489e0-f62f-43a7-8a9d-29c6b971f26a None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:46.072554 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-800489e0-f62f-43a7-8a9d-29c6b971f26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:46.142928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 93/185] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:46.142928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf165833-f3f0-46aa-ac8e-86ceaae032f0 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:46.170500 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:46.194923 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 93/186] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:46.195851 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800489e0-f62f-43a7-8a9d-29c6b971f26a None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:46.277806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf165833-f3f0-46aa-ac8e-86ceaae032f0 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:46.331304 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:46.335718 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800489e0-f62f-43a7-8a9d-29c6b971f26a None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:46.337328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1615ef8-7112-4439-be6f-5f49fa90b07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:46.337988 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1615ef8-7112-4439-be6f-5f49fa90b07c None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:46.338509 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1615ef8-7112-4439-be6f-5f49fa90b07c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:46.338783 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1615ef8-7112-4439-be6f-5f49fa90b07c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:46.360167 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1615ef8-7112-4439-be6f-5f49fa90b07c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-f1615ef8-7112-4439-be6f-5f49fa90b07c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:46.367180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:46.368063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:46.368825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:46.368825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:46.368825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:46.368825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:46.368825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:46.368825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:46.368825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:46.368825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:46.368825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:46.368825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:46.368825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:49:46.368825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:49:46.369437 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 94/187] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:46.369990 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1615ef8-7112-4439-be6f-5f49fa90b07c None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:46.385658 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315a566-ec87-49aa-8ea8-257f27b6bda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:46.386301 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315a566-ec87-49aa-8ea8-257f27b6bda9 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:46.386582 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315a566-ec87-49aa-8ea8-257f27b6bda9 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:46.386888 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315a566-ec87-49aa-8ea8-257f27b6bda9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:46.400114 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315a566-ec87-49aa-8ea8-257f27b6bda9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-7315a566-ec87-49aa-8ea8-257f27b6bda9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:46.406468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:46.408515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:46.410605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:46.410605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:46.410605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:46.410605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:46.410605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:46.410605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:46.410605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:46.410605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:46.410605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:46.410605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:46.410605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:46.410605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:46.410605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 94/188] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:49:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:46.410605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315a566-ec87-49aa-8ea8-257f27b6bda9 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:46.495967 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:46.542473 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1615ef8-7112-4439-be6f-5f49fa90b07c None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:46.568371 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315a566-ec87-49aa-8ea8-257f27b6bda9 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:46.587183 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab5106-5690-4690-bc1b-f358174b087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:46.587813 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab5106-5690-4690-bc1b-f358174b087d None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:46.588092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab5106-5690-4690-bc1b-f358174b087d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:46.588364 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab5106-5690-4690-bc1b-f358174b087d None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:46.589496 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab5106-5690-4690-bc1b-f358174b087d None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:46.591122 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab5106-5690-4690-bc1b-f358174b087d None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:46.592769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 95/189] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:46 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:46.597700 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab5106-5690-4690-bc1b-f358174b087d None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:46.615550 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f4602-f8b5-4ed4-8699-e325cd15967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:46.616168 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f4602-f8b5-4ed4-8699-e325cd15967b None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:46.616459 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f4602-f8b5-4ed4-8699-e325cd15967b None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:46.616738 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f4602-f8b5-4ed4-8699-e325cd15967b None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:46.617405 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f4602-f8b5-4ed4-8699-e325cd15967b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:46.617709 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f4602-f8b5-4ed4-8699-e325cd15967b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:46.619124 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f4602-f8b5-4ed4-8699-e325cd15967b None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:46.630308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 95/190] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:49:46 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:46.630308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f4602-f8b5-4ed4-8699-e325cd15967b None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:46.647459 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:46.708153 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab5106-5690-4690-bc1b-f358174b087d None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:46.736139 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f4602-f8b5-4ed4-8699-e325cd15967b None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:46.743516 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f62904-71a1-4f5e-b898-bb2e8d20da9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:46.744129 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f62904-71a1-4f5e-b898-bb2e8d20da9d None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:46.744410 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f62904-71a1-4f5e-b898-bb2e8d20da9d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:46.744684 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f62904-71a1-4f5e-b898-bb2e8d20da9d None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:46.745351 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f62904-71a1-4f5e-b898-bb2e8d20da9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:46.745656 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f62904-71a1-4f5e-b898-bb2e8d20da9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:46.747090 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f62904-71a1-4f5e-b898-bb2e8d20da9d None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:46.756855 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 96/191] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:46 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:46.761756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f62904-71a1-4f5e-b898-bb2e8d20da9d None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:46.771236 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:46.772239 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de35ffb-e030-4339-8b3e-449b239e510c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:46.772891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de35ffb-e030-4339-8b3e-449b239e510c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:46.773169 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de35ffb-e030-4339-8b3e-449b239e510c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:46.773439 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de35ffb-e030-4339-8b3e-449b239e510c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:46.774613 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de35ffb-e030-4339-8b3e-449b239e510c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:46.776125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de35ffb-e030-4339-8b3e-449b239e510c None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:46.777724 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 96/192] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:49:46 2022] GET /identity/v3/domains/default => generated 200 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:46.777724 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de35ffb-e030-4339-8b3e-449b239e510c None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:46.864867 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:46.871390 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f62904-71a1-4f5e-b898-bb2e8d20da9d None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:46.883294 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de35ffb-e030-4339-8b3e-449b239e510c None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:46.908673 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8c952-7ce9-4f6c-a5a9-1bf8f856c0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:46.909268 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8c952-7ce9-4f6c-a5a9-1bf8f856c0d0 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:46.909551 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8c952-7ce9-4f6c-a5a9-1bf8f856c0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:46.909828 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8c952-7ce9-4f6c-a5a9-1bf8f856c0d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:46.910576 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8c952-7ce9-4f6c-a5a9-1bf8f856c0d0 None admin] RBAC: Adding query filter params (role.id=8acc6a2016c149a0b80cf3c56b5ae91a, scope.project.id=bc381ac268c74ac7aac2f833ee1437e2, user.id=ee496f6834d34c428eca652ff60963ba) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:46.910917 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8c952-7ce9-4f6c-a5a9-1bf8f856c0d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:46.912385 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8c952-7ce9-4f6c-a5a9-1bf8f856c0d0 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:46.918587 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 97/193] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:46 2022] GET /identity/v3/role_assignments?user.id=ee496f6834d34c428eca652ff60963ba&scope.project.id=bc381ac268c74ac7aac2f833ee1437e2&role.id=8acc6a2016c149a0b80cf3c56b5ae91a => generated 610 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:46.919427 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39050139-9641-4dea-9f94-ab797d244489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:46.919568 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8c952-7ce9-4f6c-a5a9-1bf8f856c0d0 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:46.920073 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39050139-9641-4dea-9f94-ab797d244489 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:46.920360 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39050139-9641-4dea-9f94-ab797d244489 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:46.920666 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39050139-9641-4dea-9f94-ab797d244489 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:46.935177 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39050139-9641-4dea-9f94-ab797d244489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-39050139-9641-4dea-9f94-ab797d244489 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:46.940678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:46.941696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:46.942471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:46.942471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:46.942471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:46.942471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:46.942471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:46.942471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:46.942471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:46.942471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:46.942471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:46.942471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:46.942471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:49:46.942471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:46.942471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 97/194] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:49:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:46.943163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39050139-9641-4dea-9f94-ab797d244489 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:47.030866 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:47.059767 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8c952-7ce9-4f6c-a5a9-1bf8f856c0d0 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:47.069700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39050139-9641-4dea-9f94-ab797d244489 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:47.101204 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473011b-d26f-40b9-a597-a43b2402f2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:47.102195 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473011b-d26f-40b9-a597-a43b2402f2a8 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:47.102195 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473011b-d26f-40b9-a597-a43b2402f2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:47.102402 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473011b-d26f-40b9-a597-a43b2402f2a8 None admin] PATH_INFO: `/v3/users/1d64cfc4d5584597927d6e4b566654f4` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:47.103567 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473011b-d26f-40b9-a597-a43b2402f2a8 None admin] RBAC: Authorizing `identity:get_user(user_id=1d64cfc4d5584597927d6e4b566654f4)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:47.105060 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473011b-d26f-40b9-a597-a43b2402f2a8 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:47.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 98/195] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:46 2022] GET /identity/v3/users/1d64cfc4d5584597927d6e4b566654f4 => generated 290 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:47.107441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473011b-d26f-40b9-a597-a43b2402f2a8 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:47.116048 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9609bcc-3a29-4ab6-a8c1-bb6d3c3dcb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:47.116698 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9609bcc-3a29-4ab6-a8c1-bb6d3c3dcb3c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:47.116982 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9609bcc-3a29-4ab6-a8c1-bb6d3c3dcb3c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:47.117259 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9609bcc-3a29-4ab6-a8c1-bb6d3c3dcb3c None admin] PATH_INFO: `/v3/users/ee52c5ce2101433a8c5ee0f11e584cd6` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:47.130526 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:47.133012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9609bcc-3a29-4ab6-a8c1-bb6d3c3dcb3c None admin] RBAC: Authorizing `identity:get_user(user_id=ee52c5ce2101433a8c5ee0f11e584cd6)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:47.135317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9609bcc-3a29-4ab6-a8c1-bb6d3c3dcb3c None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:47.137042 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 98/196] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:46 2022] GET /identity/v3/users/ee52c5ce2101433a8c5ee0f11e584cd6 => generated 284 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:47.137826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9609bcc-3a29-4ab6-a8c1-bb6d3c3dcb3c None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:47.259417 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9609bcc-3a29-4ab6-a8c1-bb6d3c3dcb3c None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:47.260482 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473011b-d26f-40b9-a597-a43b2402f2a8 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:47.296731 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52451ad-375c-4b0c-afa5-b70b72f6e749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:47.297269 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52451ad-375c-4b0c-afa5-b70b72f6e749 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:47.297542 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52451ad-375c-4b0c-afa5-b70b72f6e749 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:47.297814 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52451ad-375c-4b0c-afa5-b70b72f6e749 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:47.298474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52451ad-375c-4b0c-afa5-b70b72f6e749 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:47.298772 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52451ad-375c-4b0c-afa5-b70b72f6e749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:47.299921 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f786590-03a4-496e-ba0e-6f6758f6e47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:47.300540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f786590-03a4-496e-ba0e-6f6758f6e47c None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:47.300634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52451ad-375c-4b0c-afa5-b70b72f6e749 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:47.300821 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f786590-03a4-496e-ba0e-6f6758f6e47c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:47.301094 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f786590-03a4-496e-ba0e-6f6758f6e47c None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:47.301823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f786590-03a4-496e-ba0e-6f6758f6e47c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:47.303343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f786590-03a4-496e-ba0e-6f6758f6e47c None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:47.310112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 99/197] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:49:47 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:47.312454 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52451ad-375c-4b0c-afa5-b70b72f6e749 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:47.380439 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:47.415850 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52451ad-375c-4b0c-afa5-b70b72f6e749 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:47.434021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:47.441270 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 99/198] 10.222.0.121 () {60 vars in 1137 bytes} [Fri Aug 26 00:49:47 2022] POST /identity/v3/users => generated 298 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:49:47.442052 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f786590-03a4-496e-ba0e-6f6758f6e47c None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:47.452738 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5581b9-d756-4fe6-b71a-7935736a59bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:47.453477 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5581b9-d756-4fe6-b71a-7935736a59bf None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:47.453763 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5581b9-d756-4fe6-b71a-7935736a59bf None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:47.454042 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5581b9-d756-4fe6-b71a-7935736a59bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:47.583628 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5581b9-d756-4fe6-b71a-7935736a59bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:47.585168 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5581b9-d756-4fe6-b71a-7935736a59bf None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:47.623410 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f786590-03a4-496e-ba0e-6f6758f6e47c None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:47.656363 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:47.666400 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34a389-4d23-4fad-913d-f0134e2e01f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:47.667071 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34a389-4d23-4fad-913d-f0134e2e01f0 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:47.667351 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34a389-4d23-4fad-913d-f0134e2e01f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:47.668517 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34a389-4d23-4fad-913d-f0134e2e01f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:47.708634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 100/199] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:49:47.709790 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5581b9-d756-4fe6-b71a-7935736a59bf None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:47.777418 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:47.780034 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34a389-4d23-4fad-913d-f0134e2e01f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:47.782135 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34a389-4d23-4fad-913d-f0134e2e01f0 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:47.862770 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5581b9-d756-4fe6-b71a-7935736a59bf None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:47.908902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be45fb-07b7-4e75-a3fe-50a9cabea940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:47.909695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be45fb-07b7-4e75-a3fe-50a9cabea940 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:47.910264 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be45fb-07b7-4e75-a3fe-50a9cabea940 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:47.910609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be45fb-07b7-4e75-a3fe-50a9cabea940 None admin] PATH_INFO: `/v3/users/ee52c5ce2101433a8c5ee0f11e584cd6` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:47.912616 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be45fb-07b7-4e75-a3fe-50a9cabea940 None admin] RBAC: Authorizing `identity:get_user(user_id=ee52c5ce2101433a8c5ee0f11e584cd6)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:47.914367 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be45fb-07b7-4e75-a3fe-50a9cabea940 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:47.916384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 101/200] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:47 2022] GET /identity/v3/users/ee52c5ce2101433a8c5ee0f11e584cd6 => generated 284 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:47.918229 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be45fb-07b7-4e75-a3fe-50a9cabea940 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:47.931622 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 100/201] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:49:47.932718 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34a389-4d23-4fad-913d-f0134e2e01f0 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:47.973583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:48.070799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:48.081214 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be45fb-07b7-4e75-a3fe-50a9cabea940 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:48.082767 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34a389-4d23-4fad-913d-f0134e2e01f0 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:48.122927 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd88cd9-501d-4897-966c-82eff2322eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:48.123983 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd88cd9-501d-4897-966c-82eff2322eb2 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:48.124461 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd88cd9-501d-4897-966c-82eff2322eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:48.124911 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd88cd9-501d-4897-966c-82eff2322eb2 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:48.126375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd88cd9-501d-4897-966c-82eff2322eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:48.128126 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd88cd9-501d-4897-966c-82eff2322eb2 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:48.130420 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 102/202] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:47 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:48.131507 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd88cd9-501d-4897-966c-82eff2322eb2 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:48.132594 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b371-5721-4deb-b049-2e4a819a8e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:48.133351 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b371-5721-4deb-b049-2e4a819a8e63 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:48.133705 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b371-5721-4deb-b049-2e4a819a8e63 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:48.134055 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b371-5721-4deb-b049-2e4a819a8e63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:48.214349 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087b371-5721-4deb-b049-2e4a819a8e63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:48.220503 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087b371-5721-4deb-b049-2e4a819a8e63 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:48.247422 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd88cd9-501d-4897-966c-82eff2322eb2 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:48.251204 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:48.286695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fb7f9-6da4-46cc-9de4-2de693e1bdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:48.287762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fb7f9-6da4-46cc-9de4-2de693e1bdac None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:48.288242 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fb7f9-6da4-46cc-9de4-2de693e1bdac None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:48.288711 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fb7f9-6da4-46cc-9de4-2de693e1bdac None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:48.290594 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fb7f9-6da4-46cc-9de4-2de693e1bdac None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:48.292854 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fb7f9-6da4-46cc-9de4-2de693e1bdac None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:48.301185 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 103/203] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:48 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:48.302426 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fb7f9-6da4-46cc-9de4-2de693e1bdac None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:48.334408 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:48.339801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 101/204] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:49:48.340838 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b371-5721-4deb-b049-2e4a819a8e63 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:48.419972 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fb7f9-6da4-46cc-9de4-2de693e1bdac None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:48.458725 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b371-5721-4deb-b049-2e4a819a8e63 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:48.459280 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f7f3f-aa61-4c4a-ab40-78ffb5ed60f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:48.460255 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7f3f-aa61-4c4a-ab40-78ffb5ed60f1 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:48.460747 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7f3f-aa61-4c4a-ab40-78ffb5ed60f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:48.461194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7f3f-aa61-4c4a-ab40-78ffb5ed60f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:48.462192 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f7f3f-aa61-4c4a-ab40-78ffb5ed60f1 None admin] RBAC: Adding query filter params (role.id=c89a332a133c4bc7b2a9a1ba7b599dd8, scope.project.id=bc381ac268c74ac7aac2f833ee1437e2, user.id=1d64cfc4d5584597927d6e4b566654f4) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:48.462723 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f7f3f-aa61-4c4a-ab40-78ffb5ed60f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:48.464550 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f7f3f-aa61-4c4a-ab40-78ffb5ed60f1 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:48.472054 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 104/205] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:48 2022] GET /identity/v3/role_assignments?user.id=1d64cfc4d5584597927d6e4b566654f4&scope.project.id=bc381ac268c74ac7aac2f833ee1437e2&role.id=c89a332a133c4bc7b2a9a1ba7b599dd8 => generated 610 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:48.473128 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f7f3f-aa61-4c4a-ab40-78ffb5ed60f1 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:48.501453 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecab6a8-fbc7-4795-841e-3150de9412cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:48.502096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecab6a8-fbc7-4795-841e-3150de9412cb None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:48.502377 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecab6a8-fbc7-4795-841e-3150de9412cb None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:48.502656 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecab6a8-fbc7-4795-841e-3150de9412cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:48.503461 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecab6a8-fbc7-4795-841e-3150de9412cb None admin] RBAC: Adding query filter params (role.id=e73a8fc0684c4f6083a71ea9a85c7298, scope.project.id=feb83e414d37430ab448d27e7af47df5, user.id=ee52c5ce2101433a8c5ee0f11e584cd6) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:48.503771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecab6a8-fbc7-4795-841e-3150de9412cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:48.505502 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecab6a8-fbc7-4795-841e-3150de9412cb None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:48.512288 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:48.512509 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 102/206] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:48 2022] GET /identity/v3/role_assignments?user.id=ee52c5ce2101433a8c5ee0f11e584cd6&scope.project.id=feb83e414d37430ab448d27e7af47df5&role.id=e73a8fc0684c4f6083a71ea9a85c7298 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:48.600837 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f7f3f-aa61-4c4a-ab40-78ffb5ed60f1 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:48.643260 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d59e67-445c-4500-a5f6-ee6f747e6aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:48.644307 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d59e67-445c-4500-a5f6-ee6f747e6aae None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:48.644789 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d59e67-445c-4500-a5f6-ee6f747e6aae None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:48.645286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d59e67-445c-4500-a5f6-ee6f747e6aae None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:48.646847 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d59e67-445c-4500-a5f6-ee6f747e6aae None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:48.648916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d59e67-445c-4500-a5f6-ee6f747e6aae None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:48.650993 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 105/207] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:48 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:48.657939 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecab6a8-fbc7-4795-841e-3150de9412cb None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:48.757036 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:48.804563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecab6a8-fbc7-4795-841e-3150de9412cb None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:48.846561 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27e55a-6599-4019-ba79-ca96bf9f36c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:48.847226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27e55a-6599-4019-ba79-ca96bf9f36c1 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:48.847507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27e55a-6599-4019-ba79-ca96bf9f36c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:48.847783 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27e55a-6599-4019-ba79-ca96bf9f36c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:48.848531 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27e55a-6599-4019-ba79-ca96bf9f36c1 None admin] RBAC: Adding query filter params (role.id=034b8b83b5934694bebbf0e19a81dc15, scope.project.id=feb83e414d37430ab448d27e7af47df5, user.id=ee52c5ce2101433a8c5ee0f11e584cd6) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:48.848842 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27e55a-6599-4019-ba79-ca96bf9f36c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:48.850328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27e55a-6599-4019-ba79-ca96bf9f36c1 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:48.856758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 103/208] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:48 2022] GET /identity/v3/role_assignments?user.id=ee52c5ce2101433a8c5ee0f11e584cd6&scope.project.id=feb83e414d37430ab448d27e7af47df5&role.id=034b8b83b5934694bebbf0e19a81dc15 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:49.929768 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230b70-e394-46d1-99f3-d1b6ea6ca5af None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:49.930271 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230b70-e394-46d1-99f3-d1b6ea6ca5af None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:49.930344 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40230b70-e394-46d1-99f3-d1b6ea6ca5af None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:49.931952 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 106/209] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:49.937962 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077afec-213a-4582-82fc-189379cd1c1a None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:49.938891 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077afec-213a-4582-82fc-189379cd1c1a None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:49.939376 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077afec-213a-4582-82fc-189379cd1c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:49.960857 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-e077afec-213a-4582-82fc-189379cd1c1a None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:49.962540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-e077afec-213a-4582-82fc-189379cd1c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:50.037416 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 104/210] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:50.135821 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199cab2-9548-49d6-a00d-a35a23d56e37 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:50.136430 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199cab2-9548-49d6-a00d-a35a23d56e37 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:50.136897 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199cab2-9548-49d6-a00d-a35a23d56e37 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:50.138433 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 107/211] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:50.144838 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba59a9d-dfb1-4e34-9785-ff2527611a8f None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:50.145426 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba59a9d-dfb1-4e34-9785-ff2527611a8f None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:50.145890 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba59a9d-dfb1-4e34-9785-ff2527611a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:50.174972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-8ba59a9d-dfb1-4e34-9785-ff2527611a8f None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:50.176495 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-8ba59a9d-dfb1-4e34-9785-ff2527611a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:50.280473 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:50.321046 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 105/212] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:50.442583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199cab2-9548-49d6-a00d-a35a23d56e37 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:50.611195 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:50.624728 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199cab2-9548-49d6-a00d-a35a23d56e37 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:50.673459 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16956cf4-f8b3-4ff5-92dd-ba293b8b06d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:50.674158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16956cf4-f8b3-4ff5-92dd-ba293b8b06d7 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:50.674503 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16956cf4-f8b3-4ff5-92dd-ba293b8b06d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:50.674780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16956cf4-f8b3-4ff5-92dd-ba293b8b06d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:50.688244 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16956cf4-f8b3-4ff5-92dd-ba293b8b06d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-16956cf4-f8b3-4ff5-92dd-ba293b8b06d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:50.693948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:50.694842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:50.695662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:50.695662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:50.695662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:50.695662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:50.695662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:50.695662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:50.695662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:50.695662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:50.695662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:50.695662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:50.695662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:50.695662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:50.695662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 108/213] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:50.701351 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba59a9d-dfb1-4e34-9785-ff2527611a8f None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:50.755086 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16956cf4-f8b3-4ff5-92dd-ba293b8b06d7 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:50.871086 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba59a9d-dfb1-4e34-9785-ff2527611a8f None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:50.888304 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16956cf4-f8b3-4ff5-92dd-ba293b8b06d7 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:50.911684 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc652a9-3d66-476f-8594-3e3dc517b725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:50.912827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc652a9-3d66-476f-8594-3e3dc517b725 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:50.913339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc652a9-3d66-476f-8594-3e3dc517b725 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:50.913818 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc652a9-3d66-476f-8594-3e3dc517b725 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:50.914751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc652a9-3d66-476f-8594-3e3dc517b725 None admin] RBAC: Adding query filter params (name=member) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:50.915331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc652a9-3d66-476f-8594-3e3dc517b725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:50.917060 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc652a9-3d66-476f-8594-3e3dc517b725 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:50.927574 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 106/214] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:49:50 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:50.932953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc652a9-3d66-476f-8594-3e3dc517b725 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:50.936915 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a62fad-538a-45df-a872-ae1a66d1d68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:50.938193 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62fad-538a-45df-a872-ae1a66d1d68a None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:50.938566 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62fad-538a-45df-a872-ae1a66d1d68a None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:50.938968 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a62fad-538a-45df-a872-ae1a66d1d68a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:50.940206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a62fad-538a-45df-a872-ae1a66d1d68a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:50.941992 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a62fad-538a-45df-a872-ae1a66d1d68a None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:50.944038 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 109/215] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:49:50 2022] GET /identity/v3/domains/default => generated 200 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:50.951218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a62fad-538a-45df-a872-ae1a66d1d68a None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:50.988907 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:50.996590 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:51.052064 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc652a9-3d66-476f-8594-3e3dc517b725 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:51.074685 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a62fad-538a-45df-a872-ae1a66d1d68a None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:51.092873 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987ac14-b483-488c-b6c5-423a8fc77e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:51.093794 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987ac14-b483-488c-b6c5-423a8fc77e7e None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:51.094226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987ac14-b483-488c-b6c5-423a8fc77e7e None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:51.094709 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987ac14-b483-488c-b6c5-423a8fc77e7e None admin] PATH_INFO: `/v3/users/8a32a729f77b46eda6270caa7c558012` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:51.110226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987ac14-b483-488c-b6c5-423a8fc77e7e None admin] RBAC: Authorizing `identity:get_user(user_id=8a32a729f77b46eda6270caa7c558012)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:51.112011 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987ac14-b483-488c-b6c5-423a8fc77e7e None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:51.117978 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1a80c-b869-4512-9473-935f488eb352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:51.118623 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 107/216] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:50 2022] GET /identity/v3/users/8a32a729f77b46eda6270caa7c558012 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:51.118730 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1a80c-b869-4512-9473-935f488eb352 None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:51.119020 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1a80c-b869-4512-9473-935f488eb352 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:51.119168 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1a80c-b869-4512-9473-935f488eb352 None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:51.119800 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1a80c-b869-4512-9473-935f488eb352 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:51.119890 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa893513-5e49-4d0e-9eaa-278b0cf873ab None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:51.120228 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa893513-5e49-4d0e-9eaa-278b0cf873ab None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:51.120476 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa893513-5e49-4d0e-9eaa-278b0cf873ab None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:51.121285 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1a80c-b869-4512-9473-935f488eb352 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:51.121918 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 108/217] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:51.122466 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa893513-5e49-4d0e-9eaa-278b0cf873ab None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:51.234966 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa893513-5e49-4d0e-9eaa-278b0cf873ab None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:51.243378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:51.264051 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 110/218] 10.222.0.121 () {60 vars in 1137 bytes} [Fri Aug 26 00:49:50 2022] POST /identity/v3/users => generated 298 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:49:51.265300 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565e019-e3b6-4a04-8909-b2e6d6bda730 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:51.265592 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565e019-e3b6-4a04-8909-b2e6d6bda730 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:51.265872 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565e019-e3b6-4a04-8909-b2e6d6bda730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:51.278001 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7c162-aba2-4dc4-8210-e08c166db541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:51.281772 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7c162-aba2-4dc4-8210-e08c166db541 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:51.281772 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7c162-aba2-4dc4-8210-e08c166db541 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:51.281772 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7c162-aba2-4dc4-8210-e08c166db541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:51.293465 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-7565e019-e3b6-4a04-8909-b2e6d6bda730 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:51.294991 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-7565e019-e3b6-4a04-8909-b2e6d6bda730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:51.374593 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7c162-aba2-4dc4-8210-e08c166db541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:51.376086 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7c162-aba2-4dc4-8210-e08c166db541 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:51.378699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 111/219] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:51.392351 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c63f95-0600-4f56-a8d0-4bf44bc86d44 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:51.398719 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c63f95-0600-4f56-a8d0-4bf44bc86d44 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:51.398719 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c63f95-0600-4f56-a8d0-4bf44bc86d44 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:51.398719 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 112/220] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:51 2022] GET /identity => generated 271 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:51.400562 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92880eb-464c-409c-bda0-6e4c02acb9c8 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:51.400849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92880eb-464c-409c-bda0-6e4c02acb9c8 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:51.402546 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92880eb-464c-409c-bda0-6e4c02acb9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:51.434436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-f92880eb-464c-409c-bda0-6e4c02acb9c8 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:51.436698 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-f92880eb-464c-409c-bda0-6e4c02acb9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:51.448527 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:51.524473 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 109/221] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:51 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:49:51.526874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 113/222] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:51.530908 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7c162-aba2-4dc4-8210-e08c166db541 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:51.540074 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:51.642446 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7c162-aba2-4dc4-8210-e08c166db541 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:51.683546 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8de23c-c407-4b82-8d25-e5f7959b2fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:51.684188 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8de23c-c407-4b82-8d25-e5f7959b2fb7 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:51.684465 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8de23c-c407-4b82-8d25-e5f7959b2fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:51.684734 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8de23c-c407-4b82-8d25-e5f7959b2fb7 None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:51.685898 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8de23c-c407-4b82-8d25-e5f7959b2fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:51.687402 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8de23c-c407-4b82-8d25-e5f7959b2fb7 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:51.689584 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 110/223] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:51 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:51.695981 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92880eb-464c-409c-bda0-6e4c02acb9c8 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:51.731563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8de23c-c407-4b82-8d25-e5f7959b2fb7 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:51.853577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92880eb-464c-409c-bda0-6e4c02acb9c8 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:51.861492 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:51.903029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8de23c-c407-4b82-8d25-e5f7959b2fb7 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:51.913479 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9614f55-7f7d-4327-8cf0-8d583937af1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:51.914370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9614f55-7f7d-4327-8cf0-8d583937af1f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:51.915860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9614f55-7f7d-4327-8cf0-8d583937af1f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:51.916283 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9614f55-7f7d-4327-8cf0-8d583937af1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:51.917604 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9614f55-7f7d-4327-8cf0-8d583937af1f None admin] RBAC: Adding query filter params (role.id=8acc6a2016c149a0b80cf3c56b5ae91a, scope.project.id=feb83e414d37430ab448d27e7af47df5, user.id=8a32a729f77b46eda6270caa7c558012) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:51.918387 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9614f55-7f7d-4327-8cf0-8d583937af1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:51.920923 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9614f55-7f7d-4327-8cf0-8d583937af1f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:51.929336 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 114/224] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:51 2022] GET /identity/v3/role_assignments?user.id=8a32a729f77b46eda6270caa7c558012&scope.project.id=feb83e414d37430ab448d27e7af47df5&role.id=8acc6a2016c149a0b80cf3c56b5ae91a => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:51.935809 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9614f55-7f7d-4327-8cf0-8d583937af1f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:51.952701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:51.961863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8d3e9-72c8-4e83-b849-f8c23724cb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:51.962521 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8d3e9-72c8-4e83-b849-f8c23724cb2d None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:51.962803 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8d3e9-72c8-4e83-b849-f8c23724cb2d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:51.963099 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8d3e9-72c8-4e83-b849-f8c23724cb2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:51.986498 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8d3e9-72c8-4e83-b849-f8c23724cb2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-4ce8d3e9-72c8-4e83-b849-f8c23724cb2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:51.991609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:51.992529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:51.993299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:51.993299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:51.993299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:51.993299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:51.993299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:51.993299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:51.993299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:51.993299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:51.993299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:51.993299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:51.993299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:51.993299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:49:51.993299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 111/225] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:49:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:49:52.001115 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8d3e9-72c8-4e83-b849-f8c23724cb2d None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:52.157478 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8d3e9-72c8-4e83-b849-f8c23724cb2d None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:52.171365 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9614f55-7f7d-4327-8cf0-8d583937af1f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:52.222798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73bb37-f38e-4171-a61f-b5b03e6f692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:52.223751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73bb37-f38e-4171-a61f-b5b03e6f692a None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:52.224032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73bb37-f38e-4171-a61f-b5b03e6f692a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:52.224443 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73bb37-f38e-4171-a61f-b5b03e6f692a None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:52.225131 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73bb37-f38e-4171-a61f-b5b03e6f692a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:52.225691 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73bb37-f38e-4171-a61f-b5b03e6f692a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:52.227730 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73bb37-f38e-4171-a61f-b5b03e6f692a None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:52.229537 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:52.242853 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 112/226] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:52 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:52.246783 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346fe57-d91e-43bd-be74-8bc1e5a200b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:52.247820 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346fe57-d91e-43bd-be74-8bc1e5a200b3 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:52.249105 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73bb37-f38e-4171-a61f-b5b03e6f692a None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:52.249569 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346fe57-d91e-43bd-be74-8bc1e5a200b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:52.250003 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346fe57-d91e-43bd-be74-8bc1e5a200b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:52.276758 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346fe57-d91e-43bd-be74-8bc1e5a200b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-4346fe57-d91e-43bd-be74-8bc1e5a200b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:52.282909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:52.283901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:52.284826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:52.284826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:52.284826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:52.284826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:52.284826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:52.284826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:52.284826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:52.284826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:52.284826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:52.284826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:52.284826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:49:52.284826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:52.292429 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 115/227] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:49:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:52.307034 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346fe57-d91e-43bd-be74-8bc1e5a200b3 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:52.409164 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73bb37-f38e-4171-a61f-b5b03e6f692a None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:52.447783 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e392a5-c268-4f13-86fb-e97c29ed3ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:52.448778 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e392a5-c268-4f13-86fb-e97c29ed3ecf None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:52.449072 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e392a5-c268-4f13-86fb-e97c29ed3ecf None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:52.449353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e392a5-c268-4f13-86fb-e97c29ed3ecf None admin] PATH_INFO: `/v3/users/ee52c5ce2101433a8c5ee0f11e584cd6` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:52.450523 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e392a5-c268-4f13-86fb-e97c29ed3ecf None admin] RBAC: Authorizing `identity:get_user(user_id=ee52c5ce2101433a8c5ee0f11e584cd6)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:52.452737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e392a5-c268-4f13-86fb-e97c29ed3ecf None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:52.454910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 113/228] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:52 2022] GET /identity/v3/users/ee52c5ce2101433a8c5ee0f11e584cd6 => generated 284 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:52.461685 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e392a5-c268-4f13-86fb-e97c29ed3ecf None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:52.473836 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:52.559143 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:52.561669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346fe57-d91e-43bd-be74-8bc1e5a200b3 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:52.628828 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e392a5-c268-4f13-86fb-e97c29ed3ecf None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:52.641486 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1cea9-5802-47fb-9c61-be025c3c8eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:52.642118 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1cea9-5802-47fb-9c61-be025c3c8eec None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:52.642398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1cea9-5802-47fb-9c61-be025c3c8eec None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:52.642675 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1cea9-5802-47fb-9c61-be025c3c8eec None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:52.643470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1cea9-5802-47fb-9c61-be025c3c8eec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:52.643794 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1cea9-5802-47fb-9c61-be025c3c8eec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:52.645588 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1cea9-5802-47fb-9c61-be025c3c8eec None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:52.660637 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 116/229] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:49:52 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:52.665052 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1cea9-5802-47fb-9c61-be025c3c8eec None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:52.697034 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb015f0-91ad-4f17-9db3-d35e1d220804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:52.697671 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb015f0-91ad-4f17-9db3-d35e1d220804 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:52.697956 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb015f0-91ad-4f17-9db3-d35e1d220804 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:52.698229 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb015f0-91ad-4f17-9db3-d35e1d220804 None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:52.699500 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb015f0-91ad-4f17-9db3-d35e1d220804 None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:52.702839 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb015f0-91ad-4f17-9db3-d35e1d220804 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:52.703603 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 114/230] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:52 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:52.710103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb015f0-91ad-4f17-9db3-d35e1d220804 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:52.846423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1cea9-5802-47fb-9c61-be025c3c8eec None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:52.907867 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:52.910306 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb015f0-91ad-4f17-9db3-d35e1d220804 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:52.931652 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b22bf3-c25c-4c25-9522-31273041d0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:52.932368 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b22bf3-c25c-4c25-9522-31273041d0d2 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:52.932748 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b22bf3-c25c-4c25-9522-31273041d0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:52.933495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b22bf3-c25c-4c25-9522-31273041d0d2 None admin] PATH_INFO: `/v3/users/ee52c5ce2101433a8c5ee0f11e584cd6` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:52.934412 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b22bf3-c25c-4c25-9522-31273041d0d2 None admin] RBAC: Authorizing `identity:get_user(user_id=ee52c5ce2101433a8c5ee0f11e584cd6)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:52.936975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b22bf3-c25c-4c25-9522-31273041d0d2 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:52.939330 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 117/231] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:52 2022] GET /identity/v3/users/ee52c5ce2101433a8c5ee0f11e584cd6 => generated 284 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:52.944915 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b22bf3-c25c-4c25-9522-31273041d0d2 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:52.950189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1bc4a-7bcd-4a56-92db-c66544a201f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:52.951174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1bc4a-7bcd-4a56-92db-c66544a201f4 None admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:52.951644 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1bc4a-7bcd-4a56-92db-c66544a201f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:52.952137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1bc4a-7bcd-4a56-92db-c66544a201f4 None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5/users/ee52c5ce2101433a8c5ee0f11e584cd6/roles/e73a8fc0684c4f6083a71ea9a85c7298` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:52.954315 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1bc4a-7bcd-4a56-92db-c66544a201f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=feb83e414d37430ab448d27e7af47df5, user_id=ee52c5ce2101433a8c5ee0f11e584cd6, role_id=e73a8fc0684c4f6083a71ea9a85c7298)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:52.956053 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1bc4a-7bcd-4a56-92db-c66544a201f4 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:52.960741 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:53.064865 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 115/232] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:49:52 2022] PUT /identity/v3/projects/feb83e414d37430ab448d27e7af47df5/users/ee52c5ce2101433a8c5ee0f11e584cd6/roles/e73a8fc0684c4f6083a71ea9a85c7298 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:49:53.070956 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b22bf3-c25c-4c25-9522-31273041d0d2 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:53.113049 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eca045-a144-48f5-971f-28c5f1adbcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:53.118163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eca045-a144-48f5-971f-28c5f1adbcd1 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:53.118163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eca045-a144-48f5-971f-28c5f1adbcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:53.118163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eca045-a144-48f5-971f-28c5f1adbcd1 None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:53.118163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eca045-a144-48f5-971f-28c5f1adbcd1 None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:53.118163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eca045-a144-48f5-971f-28c5f1adbcd1 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:53.119453 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 118/233] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:52 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:53.125588 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1bc4a-7bcd-4a56-92db-c66544a201f4 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:53.284849 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1bc4a-7bcd-4a56-92db-c66544a201f4 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:53.331384 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfb5ca-3a24-48e9-b0cf-0840129d3232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:53.332061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfb5ca-3a24-48e9-b0cf-0840129d3232 None admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:53.332345 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfb5ca-3a24-48e9-b0cf-0840129d3232 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:53.332621 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfb5ca-3a24-48e9-b0cf-0840129d3232 None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5/users/ee52c5ce2101433a8c5ee0f11e584cd6/roles/034b8b83b5934694bebbf0e19a81dc15` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:53.334844 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfb5ca-3a24-48e9-b0cf-0840129d3232 None admin] RBAC: Authorizing `identity:create_grant(project_id=feb83e414d37430ab448d27e7af47df5, user_id=ee52c5ce2101433a8c5ee0f11e584cd6, role_id=034b8b83b5934694bebbf0e19a81dc15)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:53.336342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfb5ca-3a24-48e9-b0cf-0840129d3232 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:53.493306 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 116/234] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:49:53 2022] PUT /identity/v3/projects/feb83e414d37430ab448d27e7af47df5/users/ee52c5ce2101433a8c5ee0f11e584cd6/roles/034b8b83b5934694bebbf0e19a81dc15 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:49:54.070012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c523f33-8a2e-4826-a842-95e306d6a2d6 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:54.070383 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c523f33-8a2e-4826-a842-95e306d6a2d6 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:54.070706 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c523f33-8a2e-4826-a842-95e306d6a2d6 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:54.072435 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 119/235] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:54.089051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1127b2a-b6aa-47e8-9679-b51410bdc706 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:54.089597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1127b2a-b6aa-47e8-9679-b51410bdc706 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:54.089597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1127b2a-b6aa-47e8-9679-b51410bdc706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:54.120613 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-f1127b2a-b6aa-47e8-9679-b51410bdc706 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:54.121827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-f1127b2a-b6aa-47e8-9679-b51410bdc706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:54.191286 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:54.217578 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 117/236] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:54.272351 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d926f-ef86-4cf2-ba56-559041639497 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:54.272631 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d926f-ef86-4cf2-ba56-559041639497 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:54.272910 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d926f-ef86-4cf2-ba56-559041639497 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:54.274388 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 120/237] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:54.279493 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2134fb-2acd-4eb5-be29-27af86c6d276 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:54.279834 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2134fb-2acd-4eb5-be29-27af86c6d276 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:54.280162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2134fb-2acd-4eb5-be29-27af86c6d276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:54.305198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-2d2134fb-2acd-4eb5-be29-27af86c6d276 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:54.306412 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-2d2134fb-2acd-4eb5-be29-27af86c6d276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:54.407634 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 118/238] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:49:54.637160 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d926f-ef86-4cf2-ba56-559041639497 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:54.716723 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:54.768505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d926f-ef86-4cf2-ba56-559041639497 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:54.780056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7af6f1-566f-402a-a5d8-b69dad3e2f7e None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:54.780490 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7af6f1-566f-402a-a5d8-b69dad3e2f7e None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:54.780895 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7af6f1-566f-402a-a5d8-b69dad3e2f7e None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:54.782748 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 119/239] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:54.788684 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e0abf-39b9-4240-8447-aa84d80081fe None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:54.788977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e0abf-39b9-4240-8447-aa84d80081fe None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:54.789377 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e0abf-39b9-4240-8447-aa84d80081fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:54.826895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122361d-e8d9-4f44-b528-60feb55c777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:54.827561 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122361d-e8d9-4f44-b528-60feb55c777e None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:54.827840 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122361d-e8d9-4f44-b528-60feb55c777e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:54.828112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122361d-e8d9-4f44-b528-60feb55c777e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:54.829658 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-f35e0abf-39b9-4240-8447-aa84d80081fe None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:54.830893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-f35e0abf-39b9-4240-8447-aa84d80081fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:54.846000 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122361d-e8d9-4f44-b528-60feb55c777e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-c122361d-e8d9-4f44-b528-60feb55c777e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:54.852328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:54.853329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:54.854150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:54.854150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:54.854150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:54.854150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:54.854150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:54.854150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:54.854150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:54.854150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:54.854150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:54.854150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:54.854150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:49:54.854150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:54.854150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 121/240] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:54.860917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122361d-e8d9-4f44-b528-60feb55c777e None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:54.975960 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 120/241] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:49:54.976890 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e0abf-39b9-4240-8447-aa84d80081fe None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:54.982071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122361d-e8d9-4f44-b528-60feb55c777e None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:55.034846 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:55.054878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800b291-9469-416f-a1db-f2ec77fde9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:55.055502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800b291-9469-416f-a1db-f2ec77fde9a5 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:55.055784 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800b291-9469-416f-a1db-f2ec77fde9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:55.056057 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800b291-9469-416f-a1db-f2ec77fde9a5 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:55.056726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800b291-9469-416f-a1db-f2ec77fde9a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:55.057030 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800b291-9469-416f-a1db-f2ec77fde9a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:55.059376 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800b291-9469-416f-a1db-f2ec77fde9a5 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:55.071183 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:55.084425 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 122/242] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:49:54 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:55.087757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800b291-9469-416f-a1db-f2ec77fde9a5 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:55.200978 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800b291-9469-416f-a1db-f2ec77fde9a5 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:55.242956 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565bdca-18cb-4ab0-ad4c-8147201aa694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:55.243544 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565bdca-18cb-4ab0-ad4c-8147201aa694 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:55.243829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565bdca-18cb-4ab0-ad4c-8147201aa694 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:55.244107 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565bdca-18cb-4ab0-ad4c-8147201aa694 None admin] PATH_INFO: `/v3/users/d6663a56d3d84115bd5ad6d2d5e59b78` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:55.252861 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e0abf-39b9-4240-8447-aa84d80081fe None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:55.279680 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565bdca-18cb-4ab0-ad4c-8147201aa694 None admin] RBAC: Authorizing `identity:get_user(user_id=d6663a56d3d84115bd5ad6d2d5e59b78)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:55.281183 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565bdca-18cb-4ab0-ad4c-8147201aa694 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:55.284706 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 123/243] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:55 2022] GET /identity/v3/users/d6663a56d3d84115bd5ad6d2d5e59b78 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:55.293530 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565bdca-18cb-4ab0-ad4c-8147201aa694 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:55.330693 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cd1ee-926d-4056-a8b5-55f938057284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:55.331389 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cd1ee-926d-4056-a8b5-55f938057284 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:55.331663 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cd1ee-926d-4056-a8b5-55f938057284 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:55.331955 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cd1ee-926d-4056-a8b5-55f938057284 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:55.333236 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cd1ee-926d-4056-a8b5-55f938057284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:55.334906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cd1ee-926d-4056-a8b5-55f938057284 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:55.342463 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 121/244] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:49:54 2022] GET /identity/v3/domains/default => generated 200 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:55.343521 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cd1ee-926d-4056-a8b5-55f938057284 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:55.356069 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:55.415655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565bdca-18cb-4ab0-ad4c-8147201aa694 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:55.454619 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40ed02-d2cb-495d-9665-cf82a2e91b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:55.455543 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40ed02-d2cb-495d-9665-cf82a2e91b88 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:55.455827 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40ed02-d2cb-495d-9665-cf82a2e91b88 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:55.456103 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40ed02-d2cb-495d-9665-cf82a2e91b88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:55.457021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cd1ee-926d-4056-a8b5-55f938057284 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:55.508435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:55.540855 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40ed02-d2cb-495d-9665-cf82a2e91b88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:55.541511 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebb66d-8aa4-4114-b307-99f5d05c7474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:55.542393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebb66d-8aa4-4114-b307-99f5d05c7474 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:55.542514 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40ed02-d2cb-495d-9665-cf82a2e91b88 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:55.543024 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebb66d-8aa4-4114-b307-99f5d05c7474 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:55.543498 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebb66d-8aa4-4114-b307-99f5d05c7474 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:55.559850 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebb66d-8aa4-4114-b307-99f5d05c7474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-ffebb66d-8aa4-4114-b307-99f5d05c7474 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:55.567526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:55.568428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:55.569285 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:55.569285 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:55.569285 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:55.569285 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:55.569285 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:55.569285 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:55.569285 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:55.569285 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:55.569285 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:55.569285 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:55.569285 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:49:55.569285 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:49:55.576797 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 122/245] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:49:55.576797 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebb66d-8aa4-4114-b307-99f5d05c7474 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:55.620726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:55.690133 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 124/246] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:55 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:49:55.691124 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40ed02-d2cb-495d-9665-cf82a2e91b88 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:55.723545 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebb66d-8aa4-4114-b307-99f5d05c7474 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:55.765621 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93240a81-3d4a-4f60-b1fd-69d1a390399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:55.766189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93240a81-3d4a-4f60-b1fd-69d1a390399b None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:55.766474 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93240a81-3d4a-4f60-b1fd-69d1a390399b None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:55.766751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93240a81-3d4a-4f60-b1fd-69d1a390399b None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:55.767463 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93240a81-3d4a-4f60-b1fd-69d1a390399b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:55.769043 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93240a81-3d4a-4f60-b1fd-69d1a390399b None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:55.822567 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40ed02-d2cb-495d-9665-cf82a2e91b88 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:55.858643 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdf983-4138-45fd-ad53-36aa679e0c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:55.859357 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdf983-4138-45fd-ad53-36aa679e0c97 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:55.859590 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdf983-4138-45fd-ad53-36aa679e0c97 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:55.859865 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdf983-4138-45fd-ad53-36aa679e0c97 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:55.860533 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdf983-4138-45fd-ad53-36aa679e0c97 None admin] RBAC: Adding query filter params (name=member) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:55.860837 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdf983-4138-45fd-ad53-36aa679e0c97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:55.862224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdf983-4138-45fd-ad53-36aa679e0c97 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:55.871892 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 125/247] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:49:55 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:55.873820 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdf983-4138-45fd-ad53-36aa679e0c97 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:55.883550 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:55.913376 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 123/248] 10.222.0.121 () {60 vars in 1137 bytes} [Fri Aug 26 00:49:55 2022] POST /identity/v3/users => generated 294 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:49:55.915527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59e098-2671-45b6-9578-50bb8640c5be None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:55.916019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59e098-2671-45b6-9578-50bb8640c5be None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:55.916581 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59e098-2671-45b6-9578-50bb8640c5be None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:55.926604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 124/249] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:55 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:55.926604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59e098-2671-45b6-9578-50bb8640c5be None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:55.979469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:56.024174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdf983-4138-45fd-ad53-36aa679e0c97 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:56.064412 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb83f20-2ceb-40bd-ad07-91c6eef187f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:56.065441 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb83f20-2ceb-40bd-ad07-91c6eef187f3 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:56.065922 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb83f20-2ceb-40bd-ad07-91c6eef187f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:56.066450 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb83f20-2ceb-40bd-ad07-91c6eef187f3 None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:56.067935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb83f20-2ceb-40bd-ad07-91c6eef187f3 None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:56.069716 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb83f20-2ceb-40bd-ad07-91c6eef187f3 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:56.072409 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 126/250] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:55 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:56.073923 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e60b2-0880-4990-ae88-9d01e2fbc1ba None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:56.074406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e60b2-0880-4990-ae88-9d01e2fbc1ba None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:56.074910 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e60b2-0880-4990-ae88-9d01e2fbc1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:56.081980 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59e098-2671-45b6-9578-50bb8640c5be None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:56.096198 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-049e60b2-0880-4990-ae88-9d01e2fbc1ba None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:56.098092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-049e60b2-0880-4990-ae88-9d01e2fbc1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:56.123526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23193d-7ef6-431c-a38b-b96ad0356a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:56.124278 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23193d-7ef6-431c-a38b-b96ad0356a05 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:56.124560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23193d-7ef6-431c-a38b-b96ad0356a05 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:56.124831 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23193d-7ef6-431c-a38b-b96ad0356a05 None admin] PATH_INFO: `/v3/users/8a32a729f77b46eda6270caa7c558012` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:56.126243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23193d-7ef6-431c-a38b-b96ad0356a05 None admin] RBAC: Authorizing `identity:get_user(user_id=8a32a729f77b46eda6270caa7c558012)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:56.127824 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23193d-7ef6-431c-a38b-b96ad0356a05 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:56.130451 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 125/251] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:55 2022] GET /identity/v3/users/8a32a729f77b46eda6270caa7c558012 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:56.131791 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23193d-7ef6-431c-a38b-b96ad0356a05 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:56.190853 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 127/252] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:56.190853 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e60b2-0880-4990-ae88-9d01e2fbc1ba None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:56.198927 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:56.260203 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:56.267610 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23193d-7ef6-431c-a38b-b96ad0356a05 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:56.306025 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd6e04-1272-4ceb-ba85-efdcfc099e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:56.306693 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd6e04-1272-4ceb-ba85-efdcfc099e3c None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:56.307100 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd6e04-1272-4ceb-ba85-efdcfc099e3c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:56.307469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd6e04-1272-4ceb-ba85-efdcfc099e3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:56.308302 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd6e04-1272-4ceb-ba85-efdcfc099e3c None admin] RBAC: Adding query filter params (role.id=c89a332a133c4bc7b2a9a1ba7b599dd8, scope.project.id=feb83e414d37430ab448d27e7af47df5, user.id=d6663a56d3d84115bd5ad6d2d5e59b78) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:56.308717 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd6e04-1272-4ceb-ba85-efdcfc099e3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:56.310315 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd6e04-1272-4ceb-ba85-efdcfc099e3c None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:56.317140 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 126/253] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:56 2022] GET /identity/v3/role_assignments?user.id=d6663a56d3d84115bd5ad6d2d5e59b78&scope.project.id=feb83e414d37430ab448d27e7af47df5&role.id=c89a332a133c4bc7b2a9a1ba7b599dd8 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:56.333678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e60b2-0880-4990-ae88-9d01e2fbc1ba None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:56.375509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4243f8-4429-4db5-a119-9d9908b643c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:56.376178 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4243f8-4429-4db5-a119-9d9908b643c2 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:56.376459 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4243f8-4429-4db5-a119-9d9908b643c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:56.376736 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4243f8-4429-4db5-a119-9d9908b643c2 None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:56.378013 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4243f8-4429-4db5-a119-9d9908b643c2 None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:56.379560 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4243f8-4429-4db5-a119-9d9908b643c2 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:56.381348 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 128/254] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:56 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:56.387558 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd6e04-1272-4ceb-ba85-efdcfc099e3c None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:56.424626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df1bfe-55fd-4b2f-bb2b-3a658c5c1a9f None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:56.424952 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df1bfe-55fd-4b2f-bb2b-3a658c5c1a9f None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:56.425172 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df1bfe-55fd-4b2f-bb2b-3a658c5c1a9f None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:56.427640 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 129/255] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:56.433632 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e5142-e2be-4926-b795-cc6e8b8ae69e None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:56.433923 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e5142-e2be-4926-b795-cc6e8b8ae69e None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:56.437409 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e5142-e2be-4926-b795-cc6e8b8ae69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:56.456153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-8e2e5142-e2be-4926-b795-cc6e8b8ae69e None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:56.457628 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-8e2e5142-e2be-4926-b795-cc6e8b8ae69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:56.523030 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd6e04-1272-4ceb-ba85-efdcfc099e3c None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:56.547449 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 130/256] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:49:56.568427 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf0810-7231-4585-bdb5-4a3d048d6969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:56.569206 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf0810-7231-4585-bdb5-4a3d048d6969 None admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:56.569515 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf0810-7231-4585-bdb5-4a3d048d6969 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:56.569793 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf0810-7231-4585-bdb5-4a3d048d6969 None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5/users/8a32a729f77b46eda6270caa7c558012/roles/8acc6a2016c149a0b80cf3c56b5ae91a` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:56.572233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf0810-7231-4585-bdb5-4a3d048d6969 None admin] RBAC: Authorizing `identity:create_grant(project_id=feb83e414d37430ab448d27e7af47df5, user_id=8a32a729f77b46eda6270caa7c558012, role_id=8acc6a2016c149a0b80cf3c56b5ae91a)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:56.573845 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf0810-7231-4585-bdb5-4a3d048d6969 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:56.596005 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e5142-e2be-4926-b795-cc6e8b8ae69e None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:56.598753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:56.688381 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 127/257] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:49:56 2022] PUT /identity/v3/projects/feb83e414d37430ab448d27e7af47df5/users/8a32a729f77b46eda6270caa7c558012/roles/8acc6a2016c149a0b80cf3c56b5ae91a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:49:56.715308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e5142-e2be-4926-b795-cc6e8b8ae69e None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:56.756684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4467b-b288-4dd5-872e-57f9cdec702c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:56.757495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4467b-b288-4dd5-872e-57f9cdec702c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:56.757833 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4467b-b288-4dd5-872e-57f9cdec702c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:56.758200 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4467b-b288-4dd5-872e-57f9cdec702c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:56.771465 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4467b-b288-4dd5-872e-57f9cdec702c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-7ff4467b-b288-4dd5-872e-57f9cdec702c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:56.776681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:56.777599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:56.778369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:56.778369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:56.778369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:56.778369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:56.778369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:56.778369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:56.778369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:56.778369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:56.778369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:56.778369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:56.778369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:49:56.778369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:49:56.778369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 131/258] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:49:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:49:56.785030 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf0810-7231-4585-bdb5-4a3d048d6969 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:56.812204 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:56.933354 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf0810-7231-4585-bdb5-4a3d048d6969 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:56.978322 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a21c9-6fc0-424e-b7b9-991c1a8bddb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:56.978989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a21c9-6fc0-424e-b7b9-991c1a8bddb2 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:56.979273 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a21c9-6fc0-424e-b7b9-991c1a8bddb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:56.979549 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a21c9-6fc0-424e-b7b9-991c1a8bddb2 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:56.980236 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a21c9-6fc0-424e-b7b9-991c1a8bddb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:56.980540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a21c9-6fc0-424e-b7b9-991c1a8bddb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:56.981965 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a21c9-6fc0-424e-b7b9-991c1a8bddb2 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:56.999044 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 128/259] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:49:56 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:57.004789 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4467b-b288-4dd5-872e-57f9cdec702c None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:57.096139 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:57.128321 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4467b-b288-4dd5-872e-57f9cdec702c None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:57.163239 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a21c9-6fc0-424e-b7b9-991c1a8bddb2 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:57.168779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa931296-35cb-4fd0-80ea-fe16714be7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:57.168779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa931296-35cb-4fd0-80ea-fe16714be7af None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:57.168779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa931296-35cb-4fd0-80ea-fe16714be7af None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:57.168779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa931296-35cb-4fd0-80ea-fe16714be7af None admin] PATH_INFO: `/v3/users/ee52c5ce2101433a8c5ee0f11e584cd6` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:57.170321 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa931296-35cb-4fd0-80ea-fe16714be7af None admin] RBAC: Authorizing `identity:get_user(user_id=ee52c5ce2101433a8c5ee0f11e584cd6)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:57.171822 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa931296-35cb-4fd0-80ea-fe16714be7af None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:57.174714 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 132/260] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:57 2022] GET /identity/v3/users/ee52c5ce2101433a8c5ee0f11e584cd6 => generated 284 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:57.187832 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa931296-35cb-4fd0-80ea-fe16714be7af None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:57.292541 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:57.327797 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a21c9-6fc0-424e-b7b9-991c1a8bddb2 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:57.402484 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04251894-c31b-409d-ae66-06cb7c206c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:57.403535 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04251894-c31b-409d-ae66-06cb7c206c55 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:57.404084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04251894-c31b-409d-ae66-06cb7c206c55 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:57.405064 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04251894-c31b-409d-ae66-06cb7c206c55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:57.440872 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04251894-c31b-409d-ae66-06cb7c206c55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-04251894-c31b-409d-ae66-06cb7c206c55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:49:57.446329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:49:57.447365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:49:57.448132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:49:57.448132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:49:57.448132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:49:57.448132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:49:57.448132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:49:57.448132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:49:57.448132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:49:57.448132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:49:57.448132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:49:57.448132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:49:57.448132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:49:57.448132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:49:57.448132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 129/261] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:49:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:49:57.449270 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa931296-35cb-4fd0-80ea-fe16714be7af None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:57.454618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04251894-c31b-409d-ae66-06cb7c206c55 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:57.517745 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:57.532595 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5968ae-23a7-4baa-842a-3bfd9df5407e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:57.533646 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5968ae-23a7-4baa-842a-3bfd9df5407e None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:57.534119 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5968ae-23a7-4baa-842a-3bfd9df5407e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:57.534628 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5968ae-23a7-4baa-842a-3bfd9df5407e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:57.640506 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04251894-c31b-409d-ae66-06cb7c206c55 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:57.678751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5968ae-23a7-4baa-842a-3bfd9df5407e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:57.681008 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5968ae-23a7-4baa-842a-3bfd9df5407e None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:57.705136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7a585-a418-4dc8-9db6-5368c9234caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:57.705651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7a585-a418-4dc8-9db6-5368c9234caa None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:57.706091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7a585-a418-4dc8-9db6-5368c9234caa None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:57.706407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7a585-a418-4dc8-9db6-5368c9234caa None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:57.707119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7a585-a418-4dc8-9db6-5368c9234caa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:57.707428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7a585-a418-4dc8-9db6-5368c9234caa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:57.708858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7a585-a418-4dc8-9db6-5368c9234caa None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:57.721346 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 130/262] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:49:57 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:57.727334 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7a585-a418-4dc8-9db6-5368c9234caa None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:57.738221 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:57.897669 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7a585-a418-4dc8-9db6-5368c9234caa None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:57.933692 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f26956-2d5b-49c5-be65-f912535a9feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:57.934342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f26956-2d5b-49c5-be65-f912535a9feb None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:57.934622 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f26956-2d5b-49c5-be65-f912535a9feb None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:57.934930 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f26956-2d5b-49c5-be65-f912535a9feb None admin] PATH_INFO: `/v3/users/ee52c5ce2101433a8c5ee0f11e584cd6` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:57.936831 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f26956-2d5b-49c5-be65-f912535a9feb None admin] RBAC: Authorizing `identity:get_user(user_id=ee52c5ce2101433a8c5ee0f11e584cd6)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:57.939873 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f26956-2d5b-49c5-be65-f912535a9feb None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:57.943074 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 131/263] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:49:57 2022] GET /identity/v3/users/ee52c5ce2101433a8c5ee0f11e584cd6 => generated 284 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:57.953966 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f26956-2d5b-49c5-be65-f912535a9feb None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:57.955863 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 133/264] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 768 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:49:57.974144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5968ae-23a7-4baa-842a-3bfd9df5407e None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:58.044245 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:58.148826 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:58.193975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5968ae-23a7-4baa-842a-3bfd9df5407e None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:58.224771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f26956-2d5b-49c5-be65-f912535a9feb None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:58.271786 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ee189-66f5-425c-9840-6384e3438540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:58.272438 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ee189-66f5-425c-9840-6384e3438540 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:58.272719 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ee189-66f5-425c-9840-6384e3438540 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:58.272993 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ee189-66f5-425c-9840-6384e3438540 None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:58.274323 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ee189-66f5-425c-9840-6384e3438540 None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:58.275955 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ee189-66f5-425c-9840-6384e3438540 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:58.277639 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 134/265] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:57 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:49:58.286769 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ee189-66f5-425c-9840-6384e3438540 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:58.308509 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c519a-de46-4b1d-9dc2-1253b6750a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:58.313691 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c519a-de46-4b1d-9dc2-1253b6750a46 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:58.313993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c519a-de46-4b1d-9dc2-1253b6750a46 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:58.314267 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c519a-de46-4b1d-9dc2-1253b6750a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:58.499989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c519a-de46-4b1d-9dc2-1253b6750a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:58.501499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c519a-de46-4b1d-9dc2-1253b6750a46 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:58.528790 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:58.535825 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ee189-66f5-425c-9840-6384e3438540 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:58.609465 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c34b3d-145b-4bf2-8588-6a5646af7cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:58.610506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c34b3d-145b-4bf2-8588-6a5646af7cf5 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:58.611024 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c34b3d-145b-4bf2-8588-6a5646af7cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:58.611511 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c34b3d-145b-4bf2-8588-6a5646af7cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:58.612964 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c34b3d-145b-4bf2-8588-6a5646af7cf5 None admin] RBAC: Adding query filter params (role.id=e73a8fc0684c4f6083a71ea9a85c7298, scope.project.id=feb83e414d37430ab448d27e7af47df5, user.id=ee52c5ce2101433a8c5ee0f11e584cd6) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:58.613522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c34b3d-145b-4bf2-8588-6a5646af7cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:58.618357 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c34b3d-145b-4bf2-8588-6a5646af7cf5 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:58.639963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 135/266] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:58 2022] GET /identity/v3/role_assignments?user.id=ee52c5ce2101433a8c5ee0f11e584cd6&scope.project.id=feb83e414d37430ab448d27e7af47df5&role.id=e73a8fc0684c4f6083a71ea9a85c7298 => generated 610 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:58.694570 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:58.784269 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 132/267] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:49:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 832 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:49:58.790503 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c34b3d-145b-4bf2-8588-6a5646af7cf5 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:59.010860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c34b3d-145b-4bf2-8588-6a5646af7cf5 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:59.084264 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7acb8-ac55-4387-bba9-4a3f7fd88ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:59.085354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7acb8-ac55-4387-bba9-4a3f7fd88ab5 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:59.086126 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7acb8-ac55-4387-bba9-4a3f7fd88ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:59.086615 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7acb8-ac55-4387-bba9-4a3f7fd88ab5 None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:59.088718 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7acb8-ac55-4387-bba9-4a3f7fd88ab5 None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:59.092138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7acb8-ac55-4387-bba9-4a3f7fd88ab5 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:59.095787 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 136/268] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:49:58 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:59.101320 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c519a-de46-4b1d-9dc2-1253b6750a46 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:59.253157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c519a-de46-4b1d-9dc2-1253b6750a46 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:59.320893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3e8c6-7fb4-47eb-b70c-afbbb20d1ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:59.321956 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3e8c6-7fb4-47eb-b70c-afbbb20d1ecc None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:59.322054 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3e8c6-7fb4-47eb-b70c-afbbb20d1ecc None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:59.324924 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3e8c6-7fb4-47eb-b70c-afbbb20d1ecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:59.324924 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3e8c6-7fb4-47eb-b70c-afbbb20d1ecc None admin] RBAC: Adding query filter params (role.id=034b8b83b5934694bebbf0e19a81dc15, scope.project.id=feb83e414d37430ab448d27e7af47df5, user.id=ee52c5ce2101433a8c5ee0f11e584cd6) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:59.324924 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3e8c6-7fb4-47eb-b70c-afbbb20d1ecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:59.325268 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3e8c6-7fb4-47eb-b70c-afbbb20d1ecc None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:59.332900 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 133/269] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:49:59 2022] GET /identity/v3/role_assignments?user.id=ee52c5ce2101433a8c5ee0f11e584cd6&scope.project.id=feb83e414d37430ab448d27e7af47df5&role.id=034b8b83b5934694bebbf0e19a81dc15 => generated 610 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:59.493691 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ef37-1fca-49ee-ba29-90954e2475c3 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:59.494372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ef37-1fca-49ee-ba29-90954e2475c3 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:59.494372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ef37-1fca-49ee-ba29-90954e2475c3 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:59.495602 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 137/270] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:59.505408 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9705f0c-f85b-4bc0-a932-a4e9cf8feeb5 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:59.505742 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9705f0c-f85b-4bc0-a932-a4e9cf8feeb5 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:59.505995 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9705f0c-f85b-4bc0-a932-a4e9cf8feeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:59.537752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-a9705f0c-f85b-4bc0-a932-a4e9cf8feeb5 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:59.539002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-a9705f0c-f85b-4bc0-a932-a4e9cf8feeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:59.578941 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:59.631195 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 134/271] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:49:59.891607 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a102d-8cbd-4316-9e7b-a94490159956 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:59.891983 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a102d-8cbd-4316-9e7b-a94490159956 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:59.892161 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a102d-8cbd-4316-9e7b-a94490159956 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:59.893484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 138/272] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:49:59.899934 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7036cca-dae6-44c3-a0a8-2c4359dd1530 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:59.900207 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7036cca-dae6-44c3-a0a8-2c4359dd1530 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:59.900485 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7036cca-dae6-44c3-a0a8-2c4359dd1530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:59.916021 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479e47-add6-4407-a559-5da67b770e0c None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:59.916351 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479e47-add6-4407-a559-5da67b770e0c None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:59.916570 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479e47-add6-4407-a559-5da67b770e0c None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:59.917888 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 139/273] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:49:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:49:59.919906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-b7036cca-dae6-44c3-a0a8-2c4359dd1530 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:59.921096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-b7036cca-dae6-44c3-a0a8-2c4359dd1530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:59.923213 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeda6c5-b794-4e10-a25a-450dc827926e None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:59.923551 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeda6c5-b794-4e10-a25a-450dc827926e None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:59.923832 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeda6c5-b794-4e10-a25a-450dc827926e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:59.945649 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-efeda6c5-b794-4e10-a25a-450dc827926e None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:59.947169 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-efeda6c5-b794-4e10-a25a-450dc827926e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:59.984826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:00.013394 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 135/274] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:00.020427 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7036cca-dae6-44c3-a0a8-2c4359dd1530 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:00.053319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 140/275] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:49:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:50:00.159707 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b3479-0815-4046-87c3-bb332f143838 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:00.160212 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b3479-0815-4046-87c3-bb332f143838 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:00.160638 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b3479-0815-4046-87c3-bb332f143838 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:00.162552 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 141/276] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:50:00.168500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb52ba-0979-4aa6-bb9e-73fc880c8e8d None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:00.169007 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb52ba-0979-4aa6-bb9e-73fc880c8e8d None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:00.169491 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb52ba-0979-4aa6-bb9e-73fc880c8e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:00.189599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-f4bb52ba-0979-4aa6-bb9e-73fc880c8e8d None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:00.191071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-f4bb52ba-0979-4aa6-bb9e-73fc880c8e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:00.208621 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:00.225783 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7036cca-dae6-44c3-a0a8-2c4359dd1530 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:00.279570 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cd958-3f3f-4964-b58c-69c01e9fec8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:00.280564 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cd958-3f3f-4964-b58c-69c01e9fec8a None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:00.280990 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cd958-3f3f-4964-b58c-69c01e9fec8a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:00.281482 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cd958-3f3f-4964-b58c-69c01e9fec8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:00.296277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 142/277] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:50:00.306041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cd958-3f3f-4964-b58c-69c01e9fec8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-846cd958-3f3f-4964-b58c-69c01e9fec8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:00.311051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:00.312127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:00.313191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:00.313191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:00.313191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:00.313191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:00.313191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:00.313191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:00.313191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:00.313191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:00.313191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:00.313191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:00.313191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:00.313191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:00.314580 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 136/278] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:00.320430 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb52ba-0979-4aa6-bb9e-73fc880c8e8d None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:00.377587 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cd958-3f3f-4964-b58c-69c01e9fec8a None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:00.430041 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:00.441546 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb52ba-0979-4aa6-bb9e-73fc880c8e8d None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:00.486936 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483828e2-1dbd-41d2-bb7a-84bbdbba528f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:00.487840 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483828e2-1dbd-41d2-bb7a-84bbdbba528f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:00.487840 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483828e2-1dbd-41d2-bb7a-84bbdbba528f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:00.488100 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483828e2-1dbd-41d2-bb7a-84bbdbba528f None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:00.488760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483828e2-1dbd-41d2-bb7a-84bbdbba528f None admin] RBAC: Adding query filter params (name=member) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:00.489131 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483828e2-1dbd-41d2-bb7a-84bbdbba528f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:00.490452 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483828e2-1dbd-41d2-bb7a-84bbdbba528f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:00.500642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 143/279] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:50:00 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:00.501431 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483828e2-1dbd-41d2-bb7a-84bbdbba528f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:00.520240 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cd958-3f3f-4964-b58c-69c01e9fec8a None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:00.565390 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a72bc0-00d7-4b42-a272-d93535bfe48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:00.566036 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a72bc0-00d7-4b42-a272-d93535bfe48b None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:00.566312 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a72bc0-00d7-4b42-a272-d93535bfe48b None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:00.566583 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a72bc0-00d7-4b42-a272-d93535bfe48b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:00.567930 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a72bc0-00d7-4b42-a272-d93535bfe48b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:00.569415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a72bc0-00d7-4b42-a272-d93535bfe48b None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:00.571971 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 137/280] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:00 2022] GET /identity/v3/domains/default => generated 200 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:00.572859 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a72bc0-00d7-4b42-a272-d93535bfe48b None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:00.600037 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:00.622904 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483828e2-1dbd-41d2-bb7a-84bbdbba528f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:00.660587 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017a86e-c267-4352-af1f-37df410d7766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:00.661221 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017a86e-c267-4352-af1f-37df410d7766 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:00.661488 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017a86e-c267-4352-af1f-37df410d7766 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:00.661756 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017a86e-c267-4352-af1f-37df410d7766 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:00.673217 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017a86e-c267-4352-af1f-37df410d7766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-0017a86e-c267-4352-af1f-37df410d7766 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:00.678490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:00.679423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:00.680403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:00.680403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:00.680403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:00.680403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:00.680403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:00.680403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:00.680403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:00.680403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:00.680403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:00.680403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:00.680403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:50:00.680403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:00.680403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 144/281] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:00.680403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017a86e-c267-4352-af1f-37df410d7766 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:00.686068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a72bc0-00d7-4b42-a272-d93535bfe48b None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:00.697993 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:00.722919 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f68317-8d1b-4c2c-9d6b-a676dfe01f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:00.723568 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f68317-8d1b-4c2c-9d6b-a676dfe01f60 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:00.723847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f68317-8d1b-4c2c-9d6b-a676dfe01f60 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:00.724119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f68317-8d1b-4c2c-9d6b-a676dfe01f60 None admin] PATH_INFO: `/v3/users/e54a566b6f754e32ac80fc5f34756148` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:00.738879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f68317-8d1b-4c2c-9d6b-a676dfe01f60 None admin] RBAC: Authorizing `identity:get_user(user_id=e54a566b6f754e32ac80fc5f34756148)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:00.740414 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f68317-8d1b-4c2c-9d6b-a676dfe01f60 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:00.742105 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 138/282] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:50:00 2022] GET /identity/v3/users/e54a566b6f754e32ac80fc5f34756148 => generated 294 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:00.742907 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f68317-8d1b-4c2c-9d6b-a676dfe01f60 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:00.787789 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017a86e-c267-4352-af1f-37df410d7766 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:00.834740 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:00.843060 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a6ab8-23da-4f6b-81bc-a69bba30301b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:00.843695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a6ab8-23da-4f6b-81bc-a69bba30301b None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:00.843973 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a6ab8-23da-4f6b-81bc-a69bba30301b None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:00.844243 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a6ab8-23da-4f6b-81bc-a69bba30301b None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:00.844903 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a6ab8-23da-4f6b-81bc-a69bba30301b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:00.849487 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a6ab8-23da-4f6b-81bc-a69bba30301b None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:00.857741 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f68317-8d1b-4c2c-9d6b-a676dfe01f60 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:00.892914 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7046e-4bd3-4fcc-80af-9ccc58ec77a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:00.893543 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7046e-4bd3-4fcc-80af-9ccc58ec77a4 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:00.893853 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7046e-4bd3-4fcc-80af-9ccc58ec77a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:00.894126 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7046e-4bd3-4fcc-80af-9ccc58ec77a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:00.906409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7046e-4bd3-4fcc-80af-9ccc58ec77a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-6ca7046e-4bd3-4fcc-80af-9ccc58ec77a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:00.911281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:00.912331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:00.913232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:00.913232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:00.913232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:00.913232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:00.913232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:00.913232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:00.913232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:00.913232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:00.913232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:00.913232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:00.913232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:00.913232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:00.913232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 139/283] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:00.913908 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7046e-4bd3-4fcc-80af-9ccc58ec77a4 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:01.001535 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 145/284] 10.222.0.121 () {60 vars in 1137 bytes} [Fri Aug 26 00:50:00 2022] POST /identity/v3/users => generated 294 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:50:01.002410 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a6ab8-23da-4f6b-81bc-a69bba30301b None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:01.019797 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7046e-4bd3-4fcc-80af-9ccc58ec77a4 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:01.062068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc967c43-9317-4746-9c64-db3c3363baaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:01.062701 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc967c43-9317-4746-9c64-db3c3363baaf None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:01.063013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc967c43-9317-4746-9c64-db3c3363baaf None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:01.063288 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc967c43-9317-4746-9c64-db3c3363baaf None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:01.063977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc967c43-9317-4746-9c64-db3c3363baaf None admin] RBAC: Adding query filter params (name=reader) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:01.064281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc967c43-9317-4746-9c64-db3c3363baaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:01.066073 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc967c43-9317-4746-9c64-db3c3363baaf None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:01.077811 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 140/285] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:50:00 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:01.078608 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc967c43-9317-4746-9c64-db3c3363baaf None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:01.081883 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:01.091027 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:01.131668 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a6ab8-23da-4f6b-81bc-a69bba30301b None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:01.190642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a99b7-ae4a-4bc7-a9fe-b5f95283e354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:01.191630 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a99b7-ae4a-4bc7-a9fe-b5f95283e354 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:01.192166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a99b7-ae4a-4bc7-a9fe-b5f95283e354 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:01.194115 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a99b7-ae4a-4bc7-a9fe-b5f95283e354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:01.195559 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a99b7-ae4a-4bc7-a9fe-b5f95283e354 None admin] RBAC: Adding query filter params (role.id=8acc6a2016c149a0b80cf3c56b5ae91a, user.id=e54a566b6f754e32ac80fc5f34756148, scope.system=all) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:01.196591 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a99b7-ae4a-4bc7-a9fe-b5f95283e354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:01.199104 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a99b7-ae4a-4bc7-a9fe-b5f95283e354 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:01.207691 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 146/286] 10.222.0.121 () {56 vars in 1313 bytes} [Fri Aug 26 00:50:01 2022] GET /identity/v3/role_assignments?user.id=e54a566b6f754e32ac80fc5f34756148&scope.system=all&role.id=8acc6a2016c149a0b80cf3c56b5ae91a => generated 227 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:01.208550 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a99b7-ae4a-4bc7-a9fe-b5f95283e354 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:01.221215 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc967c43-9317-4746-9c64-db3c3363baaf None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:01.268013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea844ad-b614-4490-addb-34f2d249a619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:01.268569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea844ad-b614-4490-addb-34f2d249a619 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:01.268847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea844ad-b614-4490-addb-34f2d249a619 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:01.269121 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea844ad-b614-4490-addb-34f2d249a619 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:01.269811 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea844ad-b614-4490-addb-34f2d249a619 None admin] RBAC: Adding query filter params (name=member) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:01.270120 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea844ad-b614-4490-addb-34f2d249a619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:01.271609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea844ad-b614-4490-addb-34f2d249a619 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:01.282980 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 141/287] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:50:01 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:01.288965 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea844ad-b614-4490-addb-34f2d249a619 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:01.377571 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a99b7-ae4a-4bc7-a9fe-b5f95283e354 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:01.389611 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:01.417895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:01.427547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cc057-7dfc-40fc-943d-ddc14543214f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:01.428204 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cc057-7dfc-40fc-943d-ddc14543214f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:01.446337 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cc057-7dfc-40fc-943d-ddc14543214f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:01.446337 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cc057-7dfc-40fc-943d-ddc14543214f None admin] PATH_INFO: `/v3/users/d6663a56d3d84115bd5ad6d2d5e59b78` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:01.446337 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cc057-7dfc-40fc-943d-ddc14543214f None admin] RBAC: Authorizing `identity:get_user(user_id=d6663a56d3d84115bd5ad6d2d5e59b78)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:01.446337 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cc057-7dfc-40fc-943d-ddc14543214f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:01.446337 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 147/288] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:50:01 2022] GET /identity/v3/users/d6663a56d3d84115bd5ad6d2d5e59b78 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:01.446755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea844ad-b614-4490-addb-34f2d249a619 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:01.446879 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cc057-7dfc-40fc-943d-ddc14543214f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:01.484554 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d877400-603d-4dd9-b2ca-9dd3023154ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:01.485222 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d877400-603d-4dd9-b2ca-9dd3023154ce None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:01.485708 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d877400-603d-4dd9-b2ca-9dd3023154ce None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:01.486024 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d877400-603d-4dd9-b2ca-9dd3023154ce None admin] PATH_INFO: `/v3/users/8a32a729f77b46eda6270caa7c558012` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:01.488498 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d877400-603d-4dd9-b2ca-9dd3023154ce None admin] RBAC: Authorizing `identity:get_user(user_id=8a32a729f77b46eda6270caa7c558012)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:01.489951 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d877400-603d-4dd9-b2ca-9dd3023154ce None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:01.492340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 142/289] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:50:01 2022] GET /identity/v3/users/8a32a729f77b46eda6270caa7c558012 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:01.498117 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d877400-603d-4dd9-b2ca-9dd3023154ce None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:01.636105 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cc057-7dfc-40fc-943d-ddc14543214f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:01.675488 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d877400-603d-4dd9-b2ca-9dd3023154ce None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:01.696316 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a823a5a-4e45-4604-993e-03ec9de71a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:01.696958 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a823a5a-4e45-4604-993e-03ec9de71a5d None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:01.697240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a823a5a-4e45-4604-993e-03ec9de71a5d None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:01.697502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a823a5a-4e45-4604-993e-03ec9de71a5d None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:01.699323 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a823a5a-4e45-4604-993e-03ec9de71a5d None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:01.700921 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a823a5a-4e45-4604-993e-03ec9de71a5d None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:01.704661 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 148/290] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:01 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:01.710151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a823a5a-4e45-4604-993e-03ec9de71a5d None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:01.735742 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:01.746312 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374511e9-1222-497b-a3c0-757408f68301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:01.746956 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374511e9-1222-497b-a3c0-757408f68301 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:01.747241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374511e9-1222-497b-a3c0-757408f68301 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:01.747622 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374511e9-1222-497b-a3c0-757408f68301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:01.851409 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:01.890950 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374511e9-1222-497b-a3c0-757408f68301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:01.892546 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374511e9-1222-497b-a3c0-757408f68301 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:01.923814 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a823a5a-4e45-4604-993e-03ec9de71a5d None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:01.976836 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b36fc-ef28-47c5-b914-50da9ed64d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:01.977754 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b36fc-ef28-47c5-b914-50da9ed64d1d None admin] REQUEST_METHOD: `PUT` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:01.978209 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b36fc-ef28-47c5-b914-50da9ed64d1d None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:01.978628 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b36fc-ef28-47c5-b914-50da9ed64d1d None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5/users/d6663a56d3d84115bd5ad6d2d5e59b78/roles/c89a332a133c4bc7b2a9a1ba7b599dd8` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:01.981205 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b36fc-ef28-47c5-b914-50da9ed64d1d None admin] RBAC: Authorizing `identity:create_grant(project_id=feb83e414d37430ab448d27e7af47df5, user_id=d6663a56d3d84115bd5ad6d2d5e59b78, role_id=c89a332a133c4bc7b2a9a1ba7b599dd8)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:01.983406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b36fc-ef28-47c5-b914-50da9ed64d1d None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:02.054501 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 143/291] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:01 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:50:02.060575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374511e9-1222-497b-a3c0-757408f68301 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:02.090345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 149/292] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:50:01 2022] PUT /identity/v3/projects/feb83e414d37430ab448d27e7af47df5/users/d6663a56d3d84115bd5ad6d2d5e59b78/roles/c89a332a133c4bc7b2a9a1ba7b599dd8 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:50:02.104143 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:02.213367 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374511e9-1222-497b-a3c0-757408f68301 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:02.267749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f46a8-1333-4bf6-9394-73bf43b77bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:02.268411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f46a8-1333-4bf6-9394-73bf43b77bca None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:02.268694 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f46a8-1333-4bf6-9394-73bf43b77bca None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:02.268972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f46a8-1333-4bf6-9394-73bf43b77bca None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:02.275823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f46a8-1333-4bf6-9394-73bf43b77bca None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:02.277344 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f46a8-1333-4bf6-9394-73bf43b77bca None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:02.279701 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 144/293] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:02 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:02.285900 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b36fc-ef28-47c5-b914-50da9ed64d1d None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:02.460415 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b36fc-ef28-47c5-b914-50da9ed64d1d None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:02.493064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:02.501291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5e55b-a012-4aff-93de-9c98a24cba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:02.502022 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5e55b-a012-4aff-93de-9c98a24cba66 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:02.502391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5e55b-a012-4aff-93de-9c98a24cba66 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:02.502914 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5e55b-a012-4aff-93de-9c98a24cba66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:02.503713 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5e55b-a012-4aff-93de-9c98a24cba66 None admin] RBAC: Adding query filter params (role.id=8acc6a2016c149a0b80cf3c56b5ae91a, scope.project.id=feb83e414d37430ab448d27e7af47df5, user.id=8a32a729f77b46eda6270caa7c558012) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:02.504029 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5e55b-a012-4aff-93de-9c98a24cba66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:02.505588 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5e55b-a012-4aff-93de-9c98a24cba66 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:02.513548 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 150/294] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:50:02 2022] GET /identity/v3/role_assignments?user.id=8a32a729f77b46eda6270caa7c558012&scope.project.id=feb83e414d37430ab448d27e7af47df5&role.id=8acc6a2016c149a0b80cf3c56b5ae91a => generated 610 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:03.718485 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6d071-0148-4f12-8e3c-7bc7d2f7484b None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:03.719073 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6d071-0148-4f12-8e3c-7bc7d2f7484b None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:03.719073 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6d071-0148-4f12-8e3c-7bc7d2f7484b None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:03.720479 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 145/295] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:03.726388 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d136d-1ca4-450b-8d9d-fc922c875173 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:03.727395 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d136d-1ca4-450b-8d9d-fc922c875173 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:03.727881 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d136d-1ca4-450b-8d9d-fc922c875173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:03.747807 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-ad0d136d-1ca4-450b-8d9d-fc922c875173 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:03.749331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-ad0d136d-1ca4-450b-8d9d-fc922c875173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:03.800515 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead5193-bb13-471a-9b39-dbc80332d7ed None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:03.800824 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead5193-bb13-471a-9b39-dbc80332d7ed None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:03.801067 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead5193-bb13-471a-9b39-dbc80332d7ed None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:03.802637 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 146/296] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:03.807812 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5198a-7924-4ed4-a6d6-897b55277540 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:03.808100 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5198a-7924-4ed4-a6d6-897b55277540 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:03.808375 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5198a-7924-4ed4-a6d6-897b55277540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:03.825337 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 151/297] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:03.830838 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-2ec5198a-7924-4ed4-a6d6-897b55277540 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:03.830838 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-2ec5198a-7924-4ed4-a6d6-897b55277540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:03.878336 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795542d1-54f3-429a-ba84-1928b24bad64 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:03.878687 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795542d1-54f3-429a-ba84-1928b24bad64 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:03.878902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795542d1-54f3-429a-ba84-1928b24bad64 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:03.881500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 152/298] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:50:03.886960 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2f154-201a-41df-9e86-5c08eb7ea57b None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:03.887499 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2f154-201a-41df-9e86-5c08eb7ea57b None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:03.888004 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2f154-201a-41df-9e86-5c08eb7ea57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:03.905440 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 147/299] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:50:03.916069 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-94e2f154-201a-41df-9e86-5c08eb7ea57b None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:03.917329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-94e2f154-201a-41df-9e86-5c08eb7ea57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:03.996216 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 153/300] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:50:04.216499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5198a-7924-4ed4-a6d6-897b55277540 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:04.250318 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:04.252384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2f154-201a-41df-9e86-5c08eb7ea57b None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:04.344382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:04.351789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5198a-7924-4ed4-a6d6-897b55277540 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:04.394342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f128d49-bf9f-4e31-b603-83070b464b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:04.395440 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f128d49-bf9f-4e31-b603-83070b464b0c None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:04.395873 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f128d49-bf9f-4e31-b603-83070b464b0c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:04.396281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f128d49-bf9f-4e31-b603-83070b464b0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:04.408015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f128d49-bf9f-4e31-b603-83070b464b0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-4f128d49-bf9f-4e31-b603-83070b464b0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:04.412871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:04.413973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:04.414758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:04.414758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:04.414758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:04.414758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:04.414758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:04.414758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:04.414758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:04.414758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:04.414758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:04.414758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:04.414758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:50:04.414758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:04.414758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 148/301] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:04.415427 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f128d49-bf9f-4e31-b603-83070b464b0c None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:04.419485 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2f154-201a-41df-9e86-5c08eb7ea57b None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:04.464661 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd4713-5b30-4ecf-a232-b29fa08b465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:04.465746 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd4713-5b30-4ecf-a232-b29fa08b465c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:04.466762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd4713-5b30-4ecf-a232-b29fa08b465c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:04.467288 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd4713-5b30-4ecf-a232-b29fa08b465c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:04.483206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd4713-5b30-4ecf-a232-b29fa08b465c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-a6fd4713-5b30-4ecf-a232-b29fa08b465c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:04.488500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:04.490066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:04.490878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:04.490878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:04.490878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:04.490878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:04.490878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:04.490878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:04.490878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:04.490878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:04.490878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:04.490878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:04.490878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:04.490878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:04.494740 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 154/302] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:04.495693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd4713-5b30-4ecf-a232-b29fa08b465c None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:04.545734 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:04.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f128d49-bf9f-4e31-b603-83070b464b0c None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:04.609005 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11e3fe-eaa9-41bf-8157-50e540d56ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:04.609939 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11e3fe-eaa9-41bf-8157-50e540d56ba1 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:04.610301 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11e3fe-eaa9-41bf-8157-50e540d56ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:04.610577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11e3fe-eaa9-41bf-8157-50e540d56ba1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:04.611790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11e3fe-eaa9-41bf-8157-50e540d56ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:04.613309 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11e3fe-eaa9-41bf-8157-50e540d56ba1 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:04.620363 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd4713-5b30-4ecf-a232-b29fa08b465c None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:04.620554 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 149/303] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:04 2022] GET /identity/v3/domains/default => generated 200 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:04.621451 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11e3fe-eaa9-41bf-8157-50e540d56ba1 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:04.635177 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:04.661421 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d55513-8deb-4d3b-9c3a-496369abf83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:04.662040 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55513-8deb-4d3b-9c3a-496369abf83f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:04.662318 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55513-8deb-4d3b-9c3a-496369abf83f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:04.662590 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55513-8deb-4d3b-9c3a-496369abf83f None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:04.663294 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d55513-8deb-4d3b-9c3a-496369abf83f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:04.663596 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d55513-8deb-4d3b-9c3a-496369abf83f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:04.665093 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d55513-8deb-4d3b-9c3a-496369abf83f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:04.674405 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 155/304] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:50:04 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:04.675952 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d55513-8deb-4d3b-9c3a-496369abf83f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:04.730686 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11e3fe-eaa9-41bf-8157-50e540d56ba1 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:04.768345 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939018b-e7a4-4a2a-8ead-6fc86f737413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:04.768949 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939018b-e7a4-4a2a-8ead-6fc86f737413 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:04.769228 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939018b-e7a4-4a2a-8ead-6fc86f737413 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:04.769499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939018b-e7a4-4a2a-8ead-6fc86f737413 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:04.770154 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939018b-e7a4-4a2a-8ead-6fc86f737413 None admin] RBAC: Adding query filter params (name=member) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:04.770453 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939018b-e7a4-4a2a-8ead-6fc86f737413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:04.771875 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939018b-e7a4-4a2a-8ead-6fc86f737413 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:04.780464 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 150/305] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:50:04 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:04.781815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bb5b5-8a90-4de2-a35e-2ae11c980c4e None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:04.782301 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bb5b5-8a90-4de2-a35e-2ae11c980c4e None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:04.782655 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bb5b5-8a90-4de2-a35e-2ae11c980c4e None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:04.784116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 151/306] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:04.784699 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bb5b5-8a90-4de2-a35e-2ae11c980c4e None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:04.790275 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d55513-8deb-4d3b-9c3a-496369abf83f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:04.808657 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:04.825326 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac4e6b-9e95-48ee-94ff-cd4b6c2d5738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:04.825931 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac4e6b-9e95-48ee-94ff-cd4b6c2d5738 None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:04.826206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac4e6b-9e95-48ee-94ff-cd4b6c2d5738 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:04.826477 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac4e6b-9e95-48ee-94ff-cd4b6c2d5738 None admin] PATH_INFO: `/v3/groups` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:04.827129 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac4e6b-9e95-48ee-94ff-cd4b6c2d5738 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:04.828576 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac4e6b-9e95-48ee-94ff-cd4b6c2d5738 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:04.888367 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bb5b5-8a90-4de2-a35e-2ae11c980c4e None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:04.922005 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea18142-da76-4499-8823-780d005d974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:04.922627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea18142-da76-4499-8823-780d005d974f None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:04.922931 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea18142-da76-4499-8823-780d005d974f None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:04.923204 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea18142-da76-4499-8823-780d005d974f None admin] PATH_INFO: `/v3/users/51c9051a3091408491bb6978829a07db` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:04.937136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea18142-da76-4499-8823-780d005d974f None admin] RBAC: Authorizing `identity:get_user(user_id=51c9051a3091408491bb6978829a07db)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:04.938124 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 156/307] 10.222.0.121 () {60 vars in 1139 bytes} [Fri Aug 26 00:50:04 2022] POST /identity/v3/groups => generated 230 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:50:04.938618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea18142-da76-4499-8823-780d005d974f None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:04.938989 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac4e6b-9e95-48ee-94ff-cd4b6c2d5738 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:04.940761 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 152/308] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:50:04 2022] GET /identity/v3/users/51c9051a3091408491bb6978829a07db => generated 294 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:04.941716 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b54d7-a9df-4295-9dd5-636bbcbf9e55 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:04.942002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b54d7-a9df-4295-9dd5-636bbcbf9e55 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:04.942275 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b54d7-a9df-4295-9dd5-636bbcbf9e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:04.967775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-f33b54d7-a9df-4295-9dd5-636bbcbf9e55 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:04.969107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-f33b54d7-a9df-4295-9dd5-636bbcbf9e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:05.008551 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:05.068995 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 153/309] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:05.069693 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b54d7-a9df-4295-9dd5-636bbcbf9e55 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:05.081753 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:05.097339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac4e6b-9e95-48ee-94ff-cd4b6c2d5738 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:05.149603 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd20f76-bfa9-4518-b52b-a3f8daf373b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:05.150659 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd20f76-bfa9-4518-b52b-a3f8daf373b5 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:05.151352 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd20f76-bfa9-4518-b52b-a3f8daf373b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:05.151858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd20f76-bfa9-4518-b52b-a3f8daf373b5 None admin] PATH_INFO: `/v3/users/e54a566b6f754e32ac80fc5f34756148` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:05.153287 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd20f76-bfa9-4518-b52b-a3f8daf373b5 None admin] RBAC: Authorizing `identity:get_user(user_id=e54a566b6f754e32ac80fc5f34756148)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:05.158390 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd20f76-bfa9-4518-b52b-a3f8daf373b5 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:05.161055 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 157/310] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:50:04 2022] GET /identity/v3/users/e54a566b6f754e32ac80fc5f34756148 => generated 294 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:05.168592 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd20f76-bfa9-4518-b52b-a3f8daf373b5 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:05.208993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b54d7-a9df-4295-9dd5-636bbcbf9e55 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:05.251215 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893abc1-dc3b-4efb-af27-1fc88c6f1108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:05.252554 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893abc1-dc3b-4efb-af27-1fc88c6f1108 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:05.253039 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893abc1-dc3b-4efb-af27-1fc88c6f1108 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:05.253720 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893abc1-dc3b-4efb-af27-1fc88c6f1108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:05.254771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893abc1-dc3b-4efb-af27-1fc88c6f1108 None admin] RBAC: Adding query filter params (role.id=c89a332a133c4bc7b2a9a1ba7b599dd8, user.id=51c9051a3091408491bb6978829a07db, scope.system=all) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:05.255363 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893abc1-dc3b-4efb-af27-1fc88c6f1108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:05.257211 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893abc1-dc3b-4efb-af27-1fc88c6f1108 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:05.264512 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 154/311] 10.222.0.121 () {56 vars in 1313 bytes} [Fri Aug 26 00:50:05 2022] GET /identity/v3/role_assignments?user.id=51c9051a3091408491bb6978829a07db&scope.system=all&role.id=c89a332a133c4bc7b2a9a1ba7b599dd8 => generated 227 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:05.356074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd20f76-bfa9-4518-b52b-a3f8daf373b5 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:05.358397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:05.401722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e7bdd-f87c-40b7-bf5a-0529674870a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:05.402888 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e7bdd-f87c-40b7-bf5a-0529674870a9 None admin] REQUEST_METHOD: `PUT` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:05.403893 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e7bdd-f87c-40b7-bf5a-0529674870a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:05.404398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e7bdd-f87c-40b7-bf5a-0529674870a9 None admin] PATH_INFO: `/v3/system/users/e54a566b6f754e32ac80fc5f34756148/roles/8acc6a2016c149a0b80cf3c56b5ae91a` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:05.406208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e7bdd-f87c-40b7-bf5a-0529674870a9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e54a566b6f754e32ac80fc5f34756148, role_id=8acc6a2016c149a0b80cf3c56b5ae91a)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:05.408166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e7bdd-f87c-40b7-bf5a-0529674870a9 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:05.411404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893abc1-dc3b-4efb-af27-1fc88c6f1108 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:05.516657 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 158/312] 10.222.0.121 () {58 vars in 1339 bytes} [Fri Aug 26 00:50:05 2022] PUT /identity/v3/system/users/e54a566b6f754e32ac80fc5f34756148/roles/8acc6a2016c149a0b80cf3c56b5ae91a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:50:05.520784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:05.556409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893abc1-dc3b-4efb-af27-1fc88c6f1108 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:05.598304 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb04522-5c17-463d-9775-a99d90b89dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:05.598990 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb04522-5c17-463d-9775-a99d90b89dc8 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:05.599267 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb04522-5c17-463d-9775-a99d90b89dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:05.599534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb04522-5c17-463d-9775-a99d90b89dc8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:05.612819 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb04522-5c17-463d-9775-a99d90b89dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-9fb04522-5c17-463d-9775-a99d90b89dc8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:05.617635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:05.618577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:05.619409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:05.619409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:05.619409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:05.619409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:05.619409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:05.619409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:05.619409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:05.619409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:05.619409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:05.619409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:05.619409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:50:05.619409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:05.619409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 155/313] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:05.625727 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e7bdd-f87c-40b7-bf5a-0529674870a9 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:05.773108 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e7bdd-f87c-40b7-bf5a-0529674870a9 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:05.837547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12853f87-3330-4ca0-9308-0aa4fd623946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:05.839840 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12853f87-3330-4ca0-9308-0aa4fd623946 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:05.840639 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12853f87-3330-4ca0-9308-0aa4fd623946 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:05.841598 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12853f87-3330-4ca0-9308-0aa4fd623946 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:05.843139 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12853f87-3330-4ca0-9308-0aa4fd623946 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:05.843698 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12853f87-3330-4ca0-9308-0aa4fd623946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:05.846293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12853f87-3330-4ca0-9308-0aa4fd623946 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:05.863045 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 159/314] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:50:05 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:05.870934 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb04522-5c17-463d-9775-a99d90b89dc8 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:05.984705 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb04522-5c17-463d-9775-a99d90b89dc8 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:06.015915 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:06.021750 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb0cef-e53c-4797-ba0a-a275eeb7b22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:06.022403 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb0cef-e53c-4797-ba0a-a275eeb7b22f None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:06.022987 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb0cef-e53c-4797-ba0a-a275eeb7b22f None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:06.023264 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb0cef-e53c-4797-ba0a-a275eeb7b22f None admin] PATH_INFO: `/v3/users/d6663a56d3d84115bd5ad6d2d5e59b78` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:06.024502 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb0cef-e53c-4797-ba0a-a275eeb7b22f None admin] RBAC: Authorizing `identity:get_user(user_id=d6663a56d3d84115bd5ad6d2d5e59b78)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:06.026180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb0cef-e53c-4797-ba0a-a275eeb7b22f None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:06.028080 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 156/315] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:50:05 2022] GET /identity/v3/users/d6663a56d3d84115bd5ad6d2d5e59b78 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:06.034329 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12853f87-3330-4ca0-9308-0aa4fd623946 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:06.067708 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:06.151941 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12853f87-3330-4ca0-9308-0aa4fd623946 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:06.191893 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f8b80-6ab8-492d-a30f-197c4d526ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:06.192091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f8b80-6ab8-492d-a30f-197c4d526ca2 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:06.192302 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f8b80-6ab8-492d-a30f-197c4d526ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:06.192644 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f8b80-6ab8-492d-a30f-197c4d526ca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:06.272729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f8b80-6ab8-492d-a30f-197c4d526ca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:06.274199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f8b80-6ab8-492d-a30f-197c4d526ca2 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:06.311261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:06.378639 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 160/316] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:06 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:06.384606 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb0cef-e53c-4797-ba0a-a275eeb7b22f None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:06.494075 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb0cef-e53c-4797-ba0a-a275eeb7b22f None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:06.531966 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed39ac-d6bc-4aea-b460-630f9659ef4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:06.532633 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed39ac-d6bc-4aea-b460-630f9659ef4e None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:06.532916 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed39ac-d6bc-4aea-b460-630f9659ef4e None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:06.533192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed39ac-d6bc-4aea-b460-630f9659ef4e None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:06.534439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed39ac-d6bc-4aea-b460-630f9659ef4e None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:06.535966 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed39ac-d6bc-4aea-b460-630f9659ef4e None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:06.537952 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 157/317] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:06 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:06.544335 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f8b80-6ab8-492d-a30f-197c4d526ca2 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:06.649777 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f8b80-6ab8-492d-a30f-197c4d526ca2 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:06.679762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:06.687677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54434f15-2619-4a79-ad05-fd7c4c731b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:06.688284 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54434f15-2619-4a79-ad05-fd7c4c731b1c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:06.688564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54434f15-2619-4a79-ad05-fd7c4c731b1c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:06.695400 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54434f15-2619-4a79-ad05-fd7c4c731b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:06.695400 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54434f15-2619-4a79-ad05-fd7c4c731b1c None admin] RBAC: Adding query filter params (role.id=c89a332a133c4bc7b2a9a1ba7b599dd8, scope.project.id=feb83e414d37430ab448d27e7af47df5, user.id=d6663a56d3d84115bd5ad6d2d5e59b78) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:06.695400 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54434f15-2619-4a79-ad05-fd7c4c731b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:06.695400 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54434f15-2619-4a79-ad05-fd7c4c731b1c None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:06.699053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 161/318] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:50:06 2022] GET /identity/v3/role_assignments?user.id=d6663a56d3d84115bd5ad6d2d5e59b78&scope.project.id=feb83e414d37430ab448d27e7af47df5&role.id=c89a332a133c4bc7b2a9a1ba7b599dd8 => generated 610 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:07.398215 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a88423-b006-4d4f-af42-9ed0b8e4bcc2 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:07.398743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a88423-b006-4d4f-af42-9ed0b8e4bcc2 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:07.399012 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a88423-b006-4d4f-af42-9ed0b8e4bcc2 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:07.400431 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 158/319] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:07.407060 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cb999-d60a-49c5-a919-a8ad0a73a5c1 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:07.407540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cb999-d60a-49c5-a919-a8ad0a73a5c1 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:07.407613 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cb999-d60a-49c5-a919-a8ad0a73a5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:07.427621 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-b19cb999-d60a-49c5-a919-a8ad0a73a5c1 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:07.428840 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-b19cb999-d60a-49c5-a919-a8ad0a73a5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:07.520112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 162/320] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:07.647754 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983ec74-4b92-4872-b42e-2fc711377844 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:07.648081 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983ec74-4b92-4872-b42e-2fc711377844 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:07.648314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983ec74-4b92-4872-b42e-2fc711377844 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:07.649817 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 159/321] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:07.655554 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a027c-294b-4de6-a404-f1987fa315cb None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:07.655912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a027c-294b-4de6-a404-f1987fa315cb None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:07.656151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a027c-294b-4de6-a404-f1987fa315cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:07.681832 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-229a027c-294b-4de6-a404-f1987fa315cb None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:07.683145 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-229a027c-294b-4de6-a404-f1987fa315cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:07.761869 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 163/322] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:07.860675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aa61d-cd04-4635-bab9-d5fcf75ed8a9 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:07.860994 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aa61d-cd04-4635-bab9-d5fcf75ed8a9 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:07.861232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aa61d-cd04-4635-bab9-d5fcf75ed8a9 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:07.861334 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a027c-294b-4de6-a404-f1987fa315cb None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:07.862710 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 160/323] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:07.867852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29c4f7-01ea-4b1b-a653-7093e2778fba None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:07.868144 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29c4f7-01ea-4b1b-a653-7093e2778fba None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:07.868441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29c4f7-01ea-4b1b-a653-7093e2778fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:07.886269 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-fd29c4f7-01ea-4b1b-a653-7093e2778fba None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:07.888516 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-fd29c4f7-01ea-4b1b-a653-7093e2778fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:07.923932 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:07.961765 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:07.968213 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 161/324] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:50:07.985631 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a027c-294b-4de6-a404-f1987fa315cb None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:08.027350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582499e-a905-4773-90d2-a45461f91848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:08.028009 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582499e-a905-4773-90d2-a45461f91848 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:08.028370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582499e-a905-4773-90d2-a45461f91848 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:08.028650 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582499e-a905-4773-90d2-a45461f91848 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:08.030314 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582499e-a905-4773-90d2-a45461f91848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:08.031828 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582499e-a905-4773-90d2-a45461f91848 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:08.033791 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 164/325] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:07 2022] GET /identity/v3/domains/default => generated 200 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:08.040047 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29c4f7-01ea-4b1b-a653-7093e2778fba None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:08.107078 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582499e-a905-4773-90d2-a45461f91848 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:08.174984 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29c4f7-01ea-4b1b-a653-7093e2778fba None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:08.214633 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101866b0-7388-4e97-a8d5-f4fd4de508bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:08.215273 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101866b0-7388-4e97-a8d5-f4fd4de508bb None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:08.215594 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101866b0-7388-4e97-a8d5-f4fd4de508bb None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:08.215973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101866b0-7388-4e97-a8d5-f4fd4de508bb None admin] PATH_INFO: `/v3/groups` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:08.216573 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101866b0-7388-4e97-a8d5-f4fd4de508bb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:08.218532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101866b0-7388-4e97-a8d5-f4fd4de508bb None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:08.229379 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582499e-a905-4773-90d2-a45461f91848 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:08.250487 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:08.264594 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260ddc3-2bdf-4bc4-8f89-85c41246582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:08.265218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260ddc3-2bdf-4bc4-8f89-85c41246582d None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:08.265491 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260ddc3-2bdf-4bc4-8f89-85c41246582d None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:08.265756 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260ddc3-2bdf-4bc4-8f89-85c41246582d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:08.276764 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260ddc3-2bdf-4bc4-8f89-85c41246582d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-7260ddc3-2bdf-4bc4-8f89-85c41246582d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:08.281600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:08.282564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:08.283839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:08.283839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:08.283839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:08.283839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:08.283839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:08.283839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:08.283839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:08.283839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:08.283839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:08.283839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:08.283839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:50:08.283839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:08.283839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 165/326] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:50:08.289258 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260ddc3-2bdf-4bc4-8f89-85c41246582d None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:08.352138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 162/327] 10.222.0.121 () {60 vars in 1139 bytes} [Fri Aug 26 00:50:08 2022] POST /identity/v3/groups => generated 227 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:50:08.353068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101866b0-7388-4e97-a8d5-f4fd4de508bb None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:08.413208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260ddc3-2bdf-4bc4-8f89-85c41246582d None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:08.431400 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:08.470131 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506c9f-2b0b-4a13-97c4-54cff619bee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:08.471152 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506c9f-2b0b-4a13-97c4-54cff619bee7 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:08.471581 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506c9f-2b0b-4a13-97c4-54cff619bee7 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:08.471992 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506c9f-2b0b-4a13-97c4-54cff619bee7 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:08.473056 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af506c9f-2b0b-4a13-97c4-54cff619bee7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:08.473518 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af506c9f-2b0b-4a13-97c4-54cff619bee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:08.475827 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af506c9f-2b0b-4a13-97c4-54cff619bee7 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:08.487124 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101866b0-7388-4e97-a8d5-f4fd4de508bb None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:08.490804 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 166/328] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:50:08 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:08.501375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506c9f-2b0b-4a13-97c4-54cff619bee7 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:08.531235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669c853-62f1-4e07-ab89-a359a66d11c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:08.531920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669c853-62f1-4e07-ab89-a359a66d11c0 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:08.532169 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669c853-62f1-4e07-ab89-a359a66d11c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:08.532444 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669c853-62f1-4e07-ab89-a359a66d11c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:08.547235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669c853-62f1-4e07-ab89-a359a66d11c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-6669c853-62f1-4e07-ab89-a359a66d11c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:08.552653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:08.553642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:08.554469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:08.554469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:08.554469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:08.554469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:08.554469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:08.554469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:08.554469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:08.554469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:08.554469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:08.554469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:08.554469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:08.554469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:08.554469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 163/329] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:08.560116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669c853-62f1-4e07-ab89-a359a66d11c0 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:08.560554 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:08.638373 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506c9f-2b0b-4a13-97c4-54cff619bee7 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:08.696539 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794d2c3-e6c8-4f3d-bb13-badc1fde8c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:08.698858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794d2c3-e6c8-4f3d-bb13-badc1fde8c58 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:08.698858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794d2c3-e6c8-4f3d-bb13-badc1fde8c58 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:08.698858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794d2c3-e6c8-4f3d-bb13-badc1fde8c58 None admin] PATH_INFO: `/v3/users/51c9051a3091408491bb6978829a07db` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:08.699110 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794d2c3-e6c8-4f3d-bb13-badc1fde8c58 None admin] RBAC: Authorizing `identity:get_user(user_id=51c9051a3091408491bb6978829a07db)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:08.700999 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794d2c3-e6c8-4f3d-bb13-badc1fde8c58 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:08.703839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 167/330] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:50:08 2022] GET /identity/v3/users/51c9051a3091408491bb6978829a07db => generated 294 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:08.707280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669c853-62f1-4e07-ab89-a359a66d11c0 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:08.712099 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794d2c3-e6c8-4f3d-bb13-badc1fde8c58 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:08.744123 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:08.763482 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661fc4a-ee74-4196-85e6-b7b6eb7eba03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:08.764563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661fc4a-ee74-4196-85e6-b7b6eb7eba03 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:08.766177 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661fc4a-ee74-4196-85e6-b7b6eb7eba03 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:08.767485 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661fc4a-ee74-4196-85e6-b7b6eb7eba03 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:08.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661fc4a-ee74-4196-85e6-b7b6eb7eba03 None admin] RBAC: Adding query filter params (name=member) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:08.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661fc4a-ee74-4196-85e6-b7b6eb7eba03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:08.770010 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661fc4a-ee74-4196-85e6-b7b6eb7eba03 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:08.786956 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 164/331] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:50:08 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:08.797835 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661fc4a-ee74-4196-85e6-b7b6eb7eba03 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:08.865166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794d2c3-e6c8-4f3d-bb13-badc1fde8c58 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:08.884521 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:08.916417 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703b2e8-a296-4878-bfd5-fd8ec7e12561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:08.917462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703b2e8-a296-4878-bfd5-fd8ec7e12561 None admin] REQUEST_METHOD: `PUT` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:08.918450 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703b2e8-a296-4878-bfd5-fd8ec7e12561 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:08.919781 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703b2e8-a296-4878-bfd5-fd8ec7e12561 None admin] PATH_INFO: `/v3/system/users/51c9051a3091408491bb6978829a07db/roles/c89a332a133c4bc7b2a9a1ba7b599dd8` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:08.922420 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703b2e8-a296-4878-bfd5-fd8ec7e12561 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=51c9051a3091408491bb6978829a07db, role_id=c89a332a133c4bc7b2a9a1ba7b599dd8)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:08.925137 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703b2e8-a296-4878-bfd5-fd8ec7e12561 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:08.954443 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661fc4a-ee74-4196-85e6-b7b6eb7eba03 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:08.997809 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf001aa-252c-4850-94c0-4e9d95e739aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:08.998508 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf001aa-252c-4850-94c0-4e9d95e739aa None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:08.999057 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf001aa-252c-4850-94c0-4e9d95e739aa None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:08.999346 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf001aa-252c-4850-94c0-4e9d95e739aa None admin] PATH_INFO: `/v3/users/e54a566b6f754e32ac80fc5f34756148` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:09.000634 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf001aa-252c-4850-94c0-4e9d95e739aa None admin] RBAC: Authorizing `identity:get_user(user_id=e54a566b6f754e32ac80fc5f34756148)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:09.002132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf001aa-252c-4850-94c0-4e9d95e739aa None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:09.003895 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 165/332] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:50:08 2022] GET /identity/v3/users/e54a566b6f754e32ac80fc5f34756148 => generated 294 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:09.009777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf001aa-252c-4850-94c0-4e9d95e739aa None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:09.018134 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 168/333] 10.222.0.121 () {58 vars in 1339 bytes} [Fri Aug 26 00:50:08 2022] PUT /identity/v3/system/users/51c9051a3091408491bb6978829a07db/roles/c89a332a133c4bc7b2a9a1ba7b599dd8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:50:09.073547 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:09.148382 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf001aa-252c-4850-94c0-4e9d95e739aa None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:09.204032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354a970-1d02-4c43-9800-633f6571a3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:09.205105 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354a970-1d02-4c43-9800-633f6571a3b9 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:09.205665 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354a970-1d02-4c43-9800-633f6571a3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:09.206117 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354a970-1d02-4c43-9800-633f6571a3b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:09.207104 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354a970-1d02-4c43-9800-633f6571a3b9 None admin] RBAC: Adding query filter params (role.id=8acc6a2016c149a0b80cf3c56b5ae91a, user.id=e54a566b6f754e32ac80fc5f34756148, scope.system=all) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:09.207692 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354a970-1d02-4c43-9800-633f6571a3b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:09.209443 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354a970-1d02-4c43-9800-633f6571a3b9 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:09.225118 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 166/334] 10.222.0.121 () {56 vars in 1313 bytes} [Fri Aug 26 00:50:09 2022] GET /identity/v3/role_assignments?user.id=e54a566b6f754e32ac80fc5f34756148&scope.system=all&role.id=8acc6a2016c149a0b80cf3c56b5ae91a => generated 512 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:11.260834 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170b82d-e1fb-4197-802f-250bbf3da1a7 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:11.261615 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170b82d-e1fb-4197-802f-250bbf3da1a7 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:11.261784 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170b82d-e1fb-4197-802f-250bbf3da1a7 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:11.265300 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 169/335] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:11 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:11.271783 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e72e59-b6c6-4ffd-be11-9ad480488e18 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:11.272517 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e72e59-b6c6-4ffd-be11-9ad480488e18 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:11.272648 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e72e59-b6c6-4ffd-be11-9ad480488e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:11.327567 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-e7e72e59-b6c6-4ffd-be11-9ad480488e18 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:11.329537 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-e7e72e59-b6c6-4ffd-be11-9ad480488e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:11.594106 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 167/336] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:11.865188 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce537ec-c91e-4955-91c1-80ea06d32f23 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:11.865665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce537ec-c91e-4955-91c1-80ea06d32f23 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:11.865936 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce537ec-c91e-4955-91c1-80ea06d32f23 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:11.868637 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 170/337] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:11 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:11.877686 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f9a71-5022-4c69-8787-1d9c9d311eeb None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:11.878145 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f9a71-5022-4c69-8787-1d9c9d311eeb None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:11.878619 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f9a71-5022-4c69-8787-1d9c9d311eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:11.919910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-750f9a71-5022-4c69-8787-1d9c9d311eeb None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:11.921841 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-750f9a71-5022-4c69-8787-1d9c9d311eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:11.991448 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:12.081394 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 168/338] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:12.234033 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2798c-1b7b-4060-8d81-a2625d1b94d0 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:12.234469 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2798c-1b7b-4060-8d81-a2625d1b94d0 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:12.234865 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2798c-1b7b-4060-8d81-a2625d1b94d0 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:12.237472 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 171/339] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:12 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:12.249713 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48d30a-929f-4b87-b1b3-4f6c6e425e53 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:12.250168 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48d30a-929f-4b87-b1b3-4f6c6e425e53 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:12.250626 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48d30a-929f-4b87-b1b3-4f6c6e425e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:12.289840 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-2f48d30a-929f-4b87-b1b3-4f6c6e425e53 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:12.311857 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-2f48d30a-929f-4b87-b1b3-4f6c6e425e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:12.447223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 169/340] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:12.515751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2798c-1b7b-4060-8d81-a2625d1b94d0 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:12.533350 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa047-78a0-4c84-97e7-2ccf22285612 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:12.534118 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa047-78a0-4c84-97e7-2ccf22285612 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:12.540022 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa047-78a0-4c84-97e7-2ccf22285612 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:12.542876 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 170/341] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:12 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:12.550805 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729914b-187d-4d4a-9df2-27dfa16a6796 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:12.551364 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729914b-187d-4d4a-9df2-27dfa16a6796 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:12.551781 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729914b-187d-4d4a-9df2-27dfa16a6796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:12.592008 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-8729914b-187d-4d4a-9df2-27dfa16a6796 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:12.593454 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-8729914b-187d-4d4a-9df2-27dfa16a6796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:12.736531 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 171/342] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:12.788349 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2798c-1b7b-4060-8d81-a2625d1b94d0 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:12.850202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39181737-136b-4a62-9f64-b7513c33e1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:12.851145 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39181737-136b-4a62-9f64-b7513c33e1b7 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:12.851619 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39181737-136b-4a62-9f64-b7513c33e1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:12.852032 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39181737-136b-4a62-9f64-b7513c33e1b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:12.870876 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39181737-136b-4a62-9f64-b7513c33e1b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-39181737-136b-4a62-9f64-b7513c33e1b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:12.881522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:12.882447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:12.883277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:12.883277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:12.883277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:12.883277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:12.883277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:12.883277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:12.883277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:12.883277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:12.883277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:12.883277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:12.883277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:50:12.883277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:12.884338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 172/343] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:50:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:12.889546 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729914b-187d-4d4a-9df2-27dfa16a6796 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:12.934878 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:12.974858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39181737-136b-4a62-9f64-b7513c33e1b7 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:13.030210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729914b-187d-4d4a-9df2-27dfa16a6796 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:13.043109 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:13.103404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9cd86-8b74-4596-a33f-d94891a5a323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:13.104672 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9cd86-8b74-4596-a33f-d94891a5a323 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:13.105236 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9cd86-8b74-4596-a33f-d94891a5a323 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:13.105705 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9cd86-8b74-4596-a33f-d94891a5a323 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:13.106657 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9cd86-8b74-4596-a33f-d94891a5a323 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:13.108801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9cd86-8b74-4596-a33f-d94891a5a323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:13.110528 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9cd86-8b74-4596-a33f-d94891a5a323 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:13.127275 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 172/344] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:12 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:13.128598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9cd86-8b74-4596-a33f-d94891a5a323 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:13.195890 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39181737-136b-4a62-9f64-b7513c33e1b7 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:13.242121 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507adc9f-857e-40af-9de3-d0592262b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:13.243229 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507adc9f-857e-40af-9de3-d0592262b03e None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:13.243803 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507adc9f-857e-40af-9de3-d0592262b03e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:13.244316 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507adc9f-857e-40af-9de3-d0592262b03e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:13.272421 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507adc9f-857e-40af-9de3-d0592262b03e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-507adc9f-857e-40af-9de3-d0592262b03e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:13.280165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:13.281061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:13.281829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:13.281829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:13.281829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:13.281829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:13.281829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:13.281829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:13.281829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:13.281829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:13.281829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:13.281829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:13.281829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:13.281829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:13.287467 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 173/345] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:50:13.292078 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507adc9f-857e-40af-9de3-d0592262b03e None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:13.332727 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:13.348451 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9cd86-8b74-4596-a33f-d94891a5a323 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:13.402589 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e41e7-c121-42b1-ae67-b75da96caf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:13.403392 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e41e7-c121-42b1-ae67-b75da96caf72 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:13.403689 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e41e7-c121-42b1-ae67-b75da96caf72 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:13.403954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e41e7-c121-42b1-ae67-b75da96caf72 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:13.424371 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e41e7-c121-42b1-ae67-b75da96caf72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-a87e41e7-c121-42b1-ae67-b75da96caf72 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:13.429759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:13.432056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:13.432972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:13.432972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:13.432972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:13.432972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:13.432972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:13.432972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:13.432972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:13.432972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:13.432972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:13.432972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:13.432972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:50:13.432972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:13.432972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 173/346] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:13.432972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e41e7-c121-42b1-ae67-b75da96caf72 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:13.439715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:13.454073 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507adc9f-857e-40af-9de3-d0592262b03e None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:13.509451 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dc7d3-c049-4900-b366-54ac87a6728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:13.510063 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dc7d3-c049-4900-b366-54ac87a6728a None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:13.510444 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dc7d3-c049-4900-b366-54ac87a6728a None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:13.510709 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dc7d3-c049-4900-b366-54ac87a6728a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:13.582029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e41e7-c121-42b1-ae67-b75da96caf72 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:13.625948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dc7d3-c049-4900-b366-54ac87a6728a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:13.627534 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dc7d3-c049-4900-b366-54ac87a6728a None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:13.640989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7467ff-fe9f-458a-af81-bfb324939963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:13.642073 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7467ff-fe9f-458a-af81-bfb324939963 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:13.642493 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7467ff-fe9f-458a-af81-bfb324939963 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:13.643478 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7467ff-fe9f-458a-af81-bfb324939963 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:13.644416 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7467ff-fe9f-458a-af81-bfb324939963 None admin] RBAC: Adding query filter params (name=member) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:13.644857 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7467ff-fe9f-458a-af81-bfb324939963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:13.647165 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7467ff-fe9f-458a-af81-bfb324939963 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:13.664014 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 174/347] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:50:13 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:13.664014 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f6cfd-6771-48f1-b7fb-55a62c31dc3d None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:13.664014 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f6cfd-6771-48f1-b7fb-55a62c31dc3d None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:13.664014 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f6cfd-6771-48f1-b7fb-55a62c31dc3d None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:13.664014 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 175/348] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:13.664640 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f6cfd-6771-48f1-b7fb-55a62c31dc3d None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:13.682682 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:13.759846 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:13.768789 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 174/349] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:13.769473 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dc7d3-c049-4900-b366-54ac87a6728a None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:13.812623 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f6cfd-6771-48f1-b7fb-55a62c31dc3d None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:13.881601 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a2f6a-00b2-412f-94f9-c9cef310e557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:13.881887 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2f6a-00b2-412f-94f9-c9cef310e557 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:13.882130 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2f6a-00b2-412f-94f9-c9cef310e557 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:13.882398 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a2f6a-00b2-412f-94f9-c9cef310e557 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:13.896374 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a2f6a-00b2-412f-94f9-c9cef310e557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-470a2f6a-00b2-412f-94f9-c9cef310e557 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:13.905246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:13.906210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:13.907029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:13.907029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:13.907029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:13.907029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:13.907029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:13.907029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:13.907029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:13.907029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:13.907029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:13.907029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:13.907029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:13.907029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:13.907029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 176/350] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:13.907676 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a2f6a-00b2-412f-94f9-c9cef310e557 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:13.916925 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dc7d3-c049-4900-b366-54ac87a6728a None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:13.978361 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c99bb4-83ff-4cad-b2d6-50a76e7edff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:13.979339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c99bb4-83ff-4cad-b2d6-50a76e7edff0 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:13.979688 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c99bb4-83ff-4cad-b2d6-50a76e7edff0 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:13.980449 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c99bb4-83ff-4cad-b2d6-50a76e7edff0 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:13.980750 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c99bb4-83ff-4cad-b2d6-50a76e7edff0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:13.981060 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c99bb4-83ff-4cad-b2d6-50a76e7edff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:13.982546 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c99bb4-83ff-4cad-b2d6-50a76e7edff0 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:13.994360 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 175/351] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:50:13 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:13.996779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0317d-08ec-4629-9552-4f9f81dbccc4 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:13.997110 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0317d-08ec-4629-9552-4f9f81dbccc4 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:13.999918 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0317d-08ec-4629-9552-4f9f81dbccc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:14.017708 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:14.023123 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-1ca0317d-08ec-4629-9552-4f9f81dbccc4 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:14.024394 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-1ca0317d-08ec-4629-9552-4f9f81dbccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:14.053962 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a2f6a-00b2-412f-94f9-c9cef310e557 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:14.092414 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:14.104838 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0c496-3e1d-448b-a13d-9bb4d4818dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:14.105479 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0c496-3e1d-448b-a13d-9bb4d4818dc2 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:14.105862 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0c496-3e1d-448b-a13d-9bb4d4818dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:14.106185 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0c496-3e1d-448b-a13d-9bb4d4818dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:14.123825 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 176/352] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:14.124831 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0317d-08ec-4629-9552-4f9f81dbccc4 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:14.210094 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0c496-3e1d-448b-a13d-9bb4d4818dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:14.212253 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0c496-3e1d-448b-a13d-9bb4d4818dc2 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:14.303444 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0317d-08ec-4629-9552-4f9f81dbccc4 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:14.326968 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:14.351649 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139da3e3-8210-4182-8dce-715811139565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:14.352699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139da3e3-8210-4182-8dce-715811139565 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:14.352897 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139da3e3-8210-4182-8dce-715811139565 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:14.360101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139da3e3-8210-4182-8dce-715811139565 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:14.360101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139da3e3-8210-4182-8dce-715811139565 None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:14.360101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139da3e3-8210-4182-8dce-715811139565 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:14.360101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 177/353] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:14 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:14.360101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139da3e3-8210-4182-8dce-715811139565 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:14.370919 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 177/354] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:14.372012 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0c496-3e1d-448b-a13d-9bb4d4818dc2 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:14.441696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:14.509637 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139da3e3-8210-4182-8dce-715811139565 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:14.534193 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0c496-3e1d-448b-a13d-9bb4d4818dc2 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:14.553343 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7572fc-0c3a-4404-8d12-6cc53013cd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:14.554731 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7572fc-0c3a-4404-8d12-6cc53013cd16 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:14.554731 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7572fc-0c3a-4404-8d12-6cc53013cd16 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:14.554731 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7572fc-0c3a-4404-8d12-6cc53013cd16 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:14.555590 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7572fc-0c3a-4404-8d12-6cc53013cd16 None admin] RBAC: Adding query filter params (name=member) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:14.556025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7572fc-0c3a-4404-8d12-6cc53013cd16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:14.557486 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7572fc-0c3a-4404-8d12-6cc53013cd16 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:14.567540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 178/355] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:50:14 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:14.568808 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dac171-e129-4265-a455-8424adb17d43 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:14.569096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dac171-e129-4265-a455-8424adb17d43 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:14.570264 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dac171-e129-4265-a455-8424adb17d43 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:14.571206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 179/356] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:14.571776 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dac171-e129-4265-a455-8424adb17d43 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:14.582123 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bc8b8-c122-4ca7-a5bd-7fb23da6619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:14.583124 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bc8b8-c122-4ca7-a5bd-7fb23da6619f None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:14.584114 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bc8b8-c122-4ca7-a5bd-7fb23da6619f None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:14.584624 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bc8b8-c122-4ca7-a5bd-7fb23da6619f None admin] PATH_INFO: `/v3/users/51c9051a3091408491bb6978829a07db` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:14.587102 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bc8b8-c122-4ca7-a5bd-7fb23da6619f None admin] RBAC: Authorizing `identity:get_user(user_id=51c9051a3091408491bb6978829a07db)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:14.588672 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bc8b8-c122-4ca7-a5bd-7fb23da6619f None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:14.590936 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 178/357] 10.222.0.121 () {56 vars in 1182 bytes} [Fri Aug 26 00:50:14 2022] GET /identity/v3/users/51c9051a3091408491bb6978829a07db => generated 294 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:14.591778 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bc8b8-c122-4ca7-a5bd-7fb23da6619f None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:14.641048 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:14.708385 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dac171-e129-4265-a455-8424adb17d43 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:14.727554 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bc8b8-c122-4ca7-a5bd-7fb23da6619f None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:14.728430 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:14.747249 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128868c-9759-469f-b3cf-49443b17760b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:14.747883 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128868c-9759-469f-b3cf-49443b17760b None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:14.748164 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128868c-9759-469f-b3cf-49443b17760b None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:14.748438 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128868c-9759-469f-b3cf-49443b17760b None admin] PATH_INFO: `/v3/groups/a75cf136ec634d87b021d4b61bc3393f` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:14.755175 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128868c-9759-469f-b3cf-49443b17760b None admin] RBAC: Authorizing `identity:get_group(group_id=a75cf136ec634d87b021d4b61bc3393f)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:14.756771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128868c-9759-469f-b3cf-49443b17760b None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:14.758751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 180/358] 10.222.0.121 () {56 vars in 1185 bytes} [Fri Aug 26 00:50:14 2022] GET /identity/v3/groups/a75cf136ec634d87b021d4b61bc3393f => generated 227 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:14.762677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128868c-9759-469f-b3cf-49443b17760b None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:14.772734 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcc647-43bb-4219-a0e0-f935e0b51573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:14.773636 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcc647-43bb-4219-a0e0-f935e0b51573 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:14.773972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcc647-43bb-4219-a0e0-f935e0b51573 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:14.774248 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcc647-43bb-4219-a0e0-f935e0b51573 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:14.775487 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcc647-43bb-4219-a0e0-f935e0b51573 None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:14.777145 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcc647-43bb-4219-a0e0-f935e0b51573 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:14.779463 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 179/359] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:14 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:14.780771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18b61-300f-47bc-90c1-cd788dfe4113 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:14.781191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18b61-300f-47bc-90c1-cd788dfe4113 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:14.781615 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18b61-300f-47bc-90c1-cd788dfe4113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:14.805471 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-67f18b61-300f-47bc-90c1-cd788dfe4113 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:14.806682 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-67f18b61-300f-47bc-90c1-cd788dfe4113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:14.905518 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128868c-9759-469f-b3cf-49443b17760b None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:14.913034 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 180/360] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:14.914404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18b61-300f-47bc-90c1-cd788dfe4113 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:14.946865 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f496ca-d5c0-4182-a69e-2818ebb67422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:14.948976 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f496ca-d5c0-4182-a69e-2818ebb67422 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:14.950733 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f496ca-d5c0-4182-a69e-2818ebb67422 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:14.951044 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f496ca-d5c0-4182-a69e-2818ebb67422 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:14.959124 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:14.963346 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f496ca-d5c0-4182-a69e-2818ebb67422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-b3f496ca-d5c0-4182-a69e-2818ebb67422 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:14.968780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:14.976695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:14.977498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:14.977498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:14.977498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:14.977498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:14.977498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:14.977498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:14.977498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:14.977498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:14.977498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:14.977498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:14.977498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:50:14.977498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:14.977498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 181/361] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:50:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:14.977498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f496ca-d5c0-4182-a69e-2818ebb67422 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:15.025940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:15.060290 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18b61-300f-47bc-90c1-cd788dfe4113 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:15.107875 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e71cb-a476-41dc-85e9-599e55fc529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:15.110218 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e71cb-a476-41dc-85e9-599e55fc529b None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:15.110218 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e71cb-a476-41dc-85e9-599e55fc529b None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:15.110218 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e71cb-a476-41dc-85e9-599e55fc529b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:15.115019 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f496ca-d5c0-4182-a69e-2818ebb67422 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:15.171996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd50691-651a-437d-b40b-8e38c04a6835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:15.172930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd50691-651a-437d-b40b-8e38c04a6835 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:15.173351 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd50691-651a-437d-b40b-8e38c04a6835 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:15.173759 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd50691-651a-437d-b40b-8e38c04a6835 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:15.175123 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd50691-651a-437d-b40b-8e38c04a6835 None admin] RBAC: Adding query filter params (role.id=c89a332a133c4bc7b2a9a1ba7b599dd8, user.id=51c9051a3091408491bb6978829a07db, scope.system=all) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:15.175691 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd50691-651a-437d-b40b-8e38c04a6835 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:15.178028 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd50691-651a-437d-b40b-8e38c04a6835 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:15.201971 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 182/362] 10.222.0.121 () {56 vars in 1313 bytes} [Fri Aug 26 00:50:14 2022] GET /identity/v3/role_assignments?user.id=51c9051a3091408491bb6978829a07db&scope.system=all&role.id=c89a332a133c4bc7b2a9a1ba7b599dd8 => generated 512 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:15.202959 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd50691-651a-437d-b40b-8e38c04a6835 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:15.207718 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e71cb-a476-41dc-85e9-599e55fc529b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:15.209573 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e71cb-a476-41dc-85e9-599e55fc529b None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:15.261405 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:15.342512 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:15.347989 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd50691-651a-437d-b40b-8e38c04a6835 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:15.366957 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 181/363] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:14 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:15.367854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e71cb-a476-41dc-85e9-599e55fc529b None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:15.402987 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fdbad-e65e-4de7-b655-31de131e2c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:15.403762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fdbad-e65e-4de7-b655-31de131e2c02 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:15.404081 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fdbad-e65e-4de7-b655-31de131e2c02 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:15.404321 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fdbad-e65e-4de7-b655-31de131e2c02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:15.405075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fdbad-e65e-4de7-b655-31de131e2c02 None admin] RBAC: Adding query filter params (group.id=a75cf136ec634d87b021d4b61bc3393f, role.id=034b8b83b5934694bebbf0e19a81dc15, scope.project.id=bc381ac268c74ac7aac2f833ee1437e2) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:15.405387 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fdbad-e65e-4de7-b655-31de131e2c02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:15.407011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fdbad-e65e-4de7-b655-31de131e2c02 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:15.413771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 183/364] 10.222.0.121 () {56 vars in 1381 bytes} [Fri Aug 26 00:50:15 2022] GET /identity/v3/role_assignments?group.id=a75cf136ec634d87b021d4b61bc3393f&scope.project.id=bc381ac268c74ac7aac2f833ee1437e2&role.id=034b8b83b5934694bebbf0e19a81dc15 => generated 261 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:15.417582 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fdbad-e65e-4de7-b655-31de131e2c02 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:15.552710 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e71cb-a476-41dc-85e9-599e55fc529b None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:15.584617 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fdbad-e65e-4de7-b655-31de131e2c02 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:15.609746 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cddd02-797f-4c26-8dff-edd5bb9001c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:15.611099 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cddd02-797f-4c26-8dff-edd5bb9001c3 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:15.611387 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cddd02-797f-4c26-8dff-edd5bb9001c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:15.611657 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cddd02-797f-4c26-8dff-edd5bb9001c3 None admin] PATH_INFO: `/v3/groups/a75cf136ec634d87b021d4b61bc3393f` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:15.613320 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cddd02-797f-4c26-8dff-edd5bb9001c3 None admin] RBAC: Authorizing `identity:get_group(group_id=a75cf136ec634d87b021d4b61bc3393f)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:15.617060 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cddd02-797f-4c26-8dff-edd5bb9001c3 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:15.617060 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 182/365] 10.222.0.121 () {56 vars in 1185 bytes} [Fri Aug 26 00:50:15 2022] GET /identity/v3/groups/a75cf136ec634d87b021d4b61bc3393f => generated 227 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:15.617924 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cddd02-797f-4c26-8dff-edd5bb9001c3 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:15.624017 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:15.638083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ffdb9-2887-4311-8ffe-d73436131d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:15.638778 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ffdb9-2887-4311-8ffe-d73436131d43 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:15.639013 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ffdb9-2887-4311-8ffe-d73436131d43 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:15.639282 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ffdb9-2887-4311-8ffe-d73436131d43 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:15.639951 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ffdb9-2887-4311-8ffe-d73436131d43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:15.642401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ffdb9-2887-4311-8ffe-d73436131d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:15.642401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ffdb9-2887-4311-8ffe-d73436131d43 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:15.651630 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 184/366] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:15 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:15.652796 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ffdb9-2887-4311-8ffe-d73436131d43 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:15.694227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:15.767086 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cddd02-797f-4c26-8dff-edd5bb9001c3 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:15.804139 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ffdb9-2887-4311-8ffe-d73436131d43 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:15.808445 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a8bda-3ba4-49b0-930d-6c22d0e6ded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:15.809576 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a8bda-3ba4-49b0-930d-6c22d0e6ded4 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:15.809857 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a8bda-3ba4-49b0-930d-6c22d0e6ded4 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:15.810131 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a8bda-3ba4-49b0-930d-6c22d0e6ded4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:15.824279 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a8bda-3ba4-49b0-930d-6c22d0e6ded4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-947a8bda-3ba4-49b0-930d-6c22d0e6ded4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:15.830149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:15.831251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:15.834155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:15.834155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:15.834155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:15.834155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:15.834155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:15.834155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:15.834155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:15.834155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:15.834155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:15.834155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:15.834155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:50:15.834155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:15.834155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 183/367] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:50:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:15.834155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a8bda-3ba4-49b0-930d-6c22d0e6ded4 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:15.849614 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842c165-2927-450a-b318-6d981c973436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:15.850285 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842c165-2927-450a-b318-6d981c973436 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:15.850569 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842c165-2927-450a-b318-6d981c973436 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:15.850867 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842c165-2927-450a-b318-6d981c973436 None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:15.852010 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842c165-2927-450a-b318-6d981c973436 None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:15.853481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842c165-2927-450a-b318-6d981c973436 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:15.859546 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 185/368] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:15 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:15.859546 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842c165-2927-450a-b318-6d981c973436 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:15.920657 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:15.966451 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:15.968322 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a8bda-3ba4-49b0-930d-6c22d0e6ded4 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:15.975690 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842c165-2927-450a-b318-6d981c973436 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:16.007747 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2526b82-da0e-4625-b3b0-2d0ff252d689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:16.008473 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2526b82-da0e-4625-b3b0-2d0ff252d689 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:16.008743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2526b82-da0e-4625-b3b0-2d0ff252d689 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:16.009251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2526b82-da0e-4625-b3b0-2d0ff252d689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:16.009753 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2526b82-da0e-4625-b3b0-2d0ff252d689 None admin] RBAC: Adding query filter params (group.id=a75cf136ec634d87b021d4b61bc3393f, role.id=8acc6a2016c149a0b80cf3c56b5ae91a, scope.project.id=bc381ac268c74ac7aac2f833ee1437e2) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:16.010110 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2526b82-da0e-4625-b3b0-2d0ff252d689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:16.011564 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2526b82-da0e-4625-b3b0-2d0ff252d689 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:16.014198 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079dd04-896c-4a46-9232-e55d4f1de30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:16.014809 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079dd04-896c-4a46-9232-e55d4f1de30b None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:16.015114 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079dd04-896c-4a46-9232-e55d4f1de30b None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:16.015392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079dd04-896c-4a46-9232-e55d4f1de30b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:16.017681 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 184/369] 10.222.0.121 () {56 vars in 1381 bytes} [Fri Aug 26 00:50:15 2022] GET /identity/v3/role_assignments?group.id=a75cf136ec634d87b021d4b61bc3393f&scope.project.id=bc381ac268c74ac7aac2f833ee1437e2&role.id=8acc6a2016c149a0b80cf3c56b5ae91a => generated 261 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:16.018330 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2526b82-da0e-4625-b3b0-2d0ff252d689 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:16.134360 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079dd04-896c-4a46-9232-e55d4f1de30b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:16.137500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079dd04-896c-4a46-9232-e55d4f1de30b None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:16.142848 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2526b82-da0e-4625-b3b0-2d0ff252d689 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:16.181687 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:16.192010 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43180ccd-5525-4dd5-9f17-fa110f41e847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:16.192755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43180ccd-5525-4dd5-9f17-fa110f41e847 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:16.193108 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43180ccd-5525-4dd5-9f17-fa110f41e847 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:16.193457 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43180ccd-5525-4dd5-9f17-fa110f41e847 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:16.195195 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43180ccd-5525-4dd5-9f17-fa110f41e847 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:16.195195 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43180ccd-5525-4dd5-9f17-fa110f41e847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:16.196484 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43180ccd-5525-4dd5-9f17-fa110f41e847 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:16.209911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 185/370] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:16.211334 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43180ccd-5525-4dd5-9f17-fa110f41e847 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:16.272887 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:16.286891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 186/371] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:15 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:16.287979 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079dd04-896c-4a46-9232-e55d4f1de30b None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:16.360301 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43180ccd-5525-4dd5-9f17-fa110f41e847 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:16.410837 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bd4da-2229-43e3-adc6-daa6fe3956bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:16.411562 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bd4da-2229-43e3-adc6-daa6fe3956bb None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:16.411905 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bd4da-2229-43e3-adc6-daa6fe3956bb None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:16.412255 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bd4da-2229-43e3-adc6-daa6fe3956bb None admin] PATH_INFO: `/v3/groups/a75cf136ec634d87b021d4b61bc3393f` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:16.413486 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568bd4da-2229-43e3-adc6-daa6fe3956bb None admin] RBAC: Authorizing `identity:get_group(group_id=a75cf136ec634d87b021d4b61bc3393f)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:16.415074 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568bd4da-2229-43e3-adc6-daa6fe3956bb None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:16.417054 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 186/372] 10.222.0.121 () {56 vars in 1185 bytes} [Fri Aug 26 00:50:16 2022] GET /identity/v3/groups/a75cf136ec634d87b021d4b61bc3393f => generated 227 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:16.417924 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bd4da-2229-43e3-adc6-daa6fe3956bb None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:16.425169 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079dd04-896c-4a46-9232-e55d4f1de30b None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:16.471274 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd65431-a741-411b-b9c5-04dbfdbbfe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:16.471977 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd65431-a741-411b-b9c5-04dbfdbbfe36 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:16.472333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd65431-a741-411b-b9c5-04dbfdbbfe36 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:16.472682 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd65431-a741-411b-b9c5-04dbfdbbfe36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:16.494557 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:16.541964 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:16.552974 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd65431-a741-411b-b9c5-04dbfdbbfe36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:16.554453 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd65431-a741-411b-b9c5-04dbfdbbfe36 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:16.555371 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bd4da-2229-43e3-adc6-daa6fe3956bb None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:16.614207 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df45efb-2524-4bc5-b400-158ca349229e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:16.615165 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df45efb-2524-4bc5-b400-158ca349229e None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:16.615909 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df45efb-2524-4bc5-b400-158ca349229e None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:16.616324 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df45efb-2524-4bc5-b400-158ca349229e None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:16.618567 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df45efb-2524-4bc5-b400-158ca349229e None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:16.622290 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df45efb-2524-4bc5-b400-158ca349229e None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:16.625912 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 187/373] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:16 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:16.627302 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df45efb-2524-4bc5-b400-158ca349229e None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:16.705242 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 187/374] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:16 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:16.707156 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd65431-a741-411b-b9c5-04dbfdbbfe36 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:16.766562 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df45efb-2524-4bc5-b400-158ca349229e None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:16.800192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:16.815304 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a8766-6509-475f-bea4-a6e37ebe5ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:16.816764 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a8766-6509-475f-bea4-a6e37ebe5ce2 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:16.817505 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a8766-6509-475f-bea4-a6e37ebe5ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:16.818248 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a8766-6509-475f-bea4-a6e37ebe5ce2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:16.820345 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a8766-6509-475f-bea4-a6e37ebe5ce2 None admin] RBAC: Adding query filter params (group.id=a75cf136ec634d87b021d4b61bc3393f, role.id=8acc6a2016c149a0b80cf3c56b5ae91a, scope.project.id=feb83e414d37430ab448d27e7af47df5) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:16.821207 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a8766-6509-475f-bea4-a6e37ebe5ce2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:16.824207 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a8766-6509-475f-bea4-a6e37ebe5ce2 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:16.836439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 188/375] 10.222.0.121 () {56 vars in 1381 bytes} [Fri Aug 26 00:50:16 2022] GET /identity/v3/role_assignments?group.id=a75cf136ec634d87b021d4b61bc3393f&scope.project.id=feb83e414d37430ab448d27e7af47df5&role.id=8acc6a2016c149a0b80cf3c56b5ae91a => generated 261 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:16.838339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a8766-6509-475f-bea4-a6e37ebe5ce2 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:16.841086 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:16.853346 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd65431-a741-411b-b9c5-04dbfdbbfe36 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:16.895245 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77352b-eaf9-44a5-9337-7b215d4f425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:16.895960 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77352b-eaf9-44a5-9337-7b215d4f425c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:16.896239 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77352b-eaf9-44a5-9337-7b215d4f425c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:16.896514 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77352b-eaf9-44a5-9337-7b215d4f425c None admin] PATH_INFO: `/v3/groups/a75cf136ec634d87b021d4b61bc3393f` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:16.897641 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77352b-eaf9-44a5-9337-7b215d4f425c None admin] RBAC: Authorizing `identity:get_group(group_id=a75cf136ec634d87b021d4b61bc3393f)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:16.899848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77352b-eaf9-44a5-9337-7b215d4f425c None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:16.901992 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 188/376] 10.222.0.121 () {56 vars in 1185 bytes} [Fri Aug 26 00:50:16 2022] GET /identity/v3/groups/a75cf136ec634d87b021d4b61bc3393f => generated 227 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:16.910977 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77352b-eaf9-44a5-9337-7b215d4f425c None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:17.059201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77352b-eaf9-44a5-9337-7b215d4f425c None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:17.102875 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db37749-1389-4dea-839d-6012466580ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:17.102875 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db37749-1389-4dea-839d-6012466580ab None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:17.102875 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db37749-1389-4dea-839d-6012466580ab None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:17.102875 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db37749-1389-4dea-839d-6012466580ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:17.103500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db37749-1389-4dea-839d-6012466580ab None admin] RBAC: Adding query filter params (group.id=a75cf136ec634d87b021d4b61bc3393f, role.id=034b8b83b5934694bebbf0e19a81dc15, scope.project.id=feb83e414d37430ab448d27e7af47df5) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:17.103500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db37749-1389-4dea-839d-6012466580ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:17.103731 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db37749-1389-4dea-839d-6012466580ab None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:17.110881 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 189/377] 10.222.0.121 () {56 vars in 1381 bytes} [Fri Aug 26 00:50:16 2022] GET /identity/v3/role_assignments?group.id=a75cf136ec634d87b021d4b61bc3393f&scope.project.id=feb83e414d37430ab448d27e7af47df5&role.id=034b8b83b5934694bebbf0e19a81dc15 => generated 261 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:17.165294 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a8766-6509-475f-bea4-a6e37ebe5ce2 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:17.212707 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51566-2c85-4298-ae3b-28bece31e8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:17.213641 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51566-2c85-4298-ae3b-28bece31e8cd None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:17.214140 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51566-2c85-4298-ae3b-28bece31e8cd None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:17.214610 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51566-2c85-4298-ae3b-28bece31e8cd None admin] PATH_INFO: `/v3/projects/e4454f1e3bf94358ad484413a3205af0` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:17.216266 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f51566-2c85-4298-ae3b-28bece31e8cd None admin] RBAC: Authorizing `identity:get_project(project_id=e4454f1e3bf94358ad484413a3205af0)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:17.218003 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f51566-2c85-4298-ae3b-28bece31e8cd None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:17.220128 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 189/378] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:16 2022] GET /identity/v3/projects/e4454f1e3bf94358ad484413a3205af0 => generated 345 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:17.226231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db37749-1389-4dea-839d-6012466580ab None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:17.267484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:17.384087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db37749-1389-4dea-839d-6012466580ab None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:17.434970 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9066c-87ee-47f4-904e-59d4113f5a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:17.435626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9066c-87ee-47f4-904e-59d4113f5a8f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:17.435902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9066c-87ee-47f4-904e-59d4113f5a8f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:17.436174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9066c-87ee-47f4-904e-59d4113f5a8f None admin] PATH_INFO: `/v3/groups/b50dd6e5862e49c5973694870b25abf8` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:17.443647 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9066c-87ee-47f4-904e-59d4113f5a8f None admin] RBAC: Authorizing `identity:get_group(group_id=b50dd6e5862e49c5973694870b25abf8)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:17.446130 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9066c-87ee-47f4-904e-59d4113f5a8f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:17.448544 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 190/379] 10.222.0.121 () {56 vars in 1185 bytes} [Fri Aug 26 00:50:17 2022] GET /identity/v3/groups/b50dd6e5862e49c5973694870b25abf8 => generated 230 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:17.458394 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51566-2c85-4298-ae3b-28bece31e8cd None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:17.552136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:17.593981 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51566-2c85-4298-ae3b-28bece31e8cd None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:17.654533 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea66e86-f57e-4533-bfe9-f5d0d62b1fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:17.655238 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea66e86-f57e-4533-bfe9-f5d0d62b1fe1 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:17.655537 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea66e86-f57e-4533-bfe9-f5d0d62b1fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:17.655799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea66e86-f57e-4533-bfe9-f5d0d62b1fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:17.656528 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea66e86-f57e-4533-bfe9-f5d0d62b1fe1 None admin] RBAC: Adding query filter params (group.id=b50dd6e5862e49c5973694870b25abf8, role.id=e73a8fc0684c4f6083a71ea9a85c7298, scope.project.id=e4454f1e3bf94358ad484413a3205af0) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:17.656830 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea66e86-f57e-4533-bfe9-f5d0d62b1fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:17.658373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea66e86-f57e-4533-bfe9-f5d0d62b1fe1 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:17.664910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 190/380] 10.222.0.121 () {56 vars in 1381 bytes} [Fri Aug 26 00:50:17 2022] GET /identity/v3/role_assignments?group.id=b50dd6e5862e49c5973694870b25abf8&scope.project.id=e4454f1e3bf94358ad484413a3205af0&role.id=e73a8fc0684c4f6083a71ea9a85c7298 => generated 261 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:17.904480 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ade1b6-ddb1-47d2-8e43-101b72636566 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:17.905326 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ade1b6-ddb1-47d2-8e43-101b72636566 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:17.905326 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ade1b6-ddb1-47d2-8e43-101b72636566 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:17.906641 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 191/381] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:17.912602 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edff28-fdcd-4b6e-a029-c9baf4386c51 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:17.912873 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edff28-fdcd-4b6e-a029-c9baf4386c51 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:17.913154 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edff28-fdcd-4b6e-a029-c9baf4386c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:17.934410 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-61edff28-fdcd-4b6e-a029-c9baf4386c51 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:17.935681 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-61edff28-fdcd-4b6e-a029-c9baf4386c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:18.029643 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 191/382] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:18.486528 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ade1b6-ddb1-47d2-8e43-101b72636566 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:18.604083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:18.628590 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ade1b6-ddb1-47d2-8e43-101b72636566 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:18.682201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c45af-2982-4fb5-b7c8-dc0b89b3995e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:18.682887 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c45af-2982-4fb5-b7c8-dc0b89b3995e None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:18.683164 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c45af-2982-4fb5-b7c8-dc0b89b3995e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:18.683431 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c45af-2982-4fb5-b7c8-dc0b89b3995e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:18.700944 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c45af-2982-4fb5-b7c8-dc0b89b3995e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-113c45af-2982-4fb5-b7c8-dc0b89b3995e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:18.705762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:18.706683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:18.707523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:18.707523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:18.707523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:18.707523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:18.707523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:18.707523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:18.707523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:18.707523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:18.707523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:18.707523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:18.707523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:50:18.707523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:18.707523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 192/383] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:50:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:18.716250 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edff28-fdcd-4b6e-a029-c9baf4386c51 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:18.725263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab011c-5694-4e77-aa59-5545285aac6e None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:18.725724 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab011c-5694-4e77-aa59-5545285aac6e None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:18.726177 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab011c-5694-4e77-aa59-5545285aac6e None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:18.729027 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 193/384] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:18 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:18.735133 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728ae03-cc09-4514-ab93-ebfb5d4c28a1 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:18.735606 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728ae03-cc09-4514-ab93-ebfb5d4c28a1 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:18.736094 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728ae03-cc09-4514-ab93-ebfb5d4c28a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:18.776872 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-e728ae03-cc09-4514-ab93-ebfb5d4c28a1 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:18.778842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-e728ae03-cc09-4514-ab93-ebfb5d4c28a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:18.823223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:18.899650 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edff28-fdcd-4b6e-a029-c9baf4386c51 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:18.949914 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 194/385] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:50:18.953003 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cb52f-e261-4f5d-8cb5-73cb152a2fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:18.953643 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cb52f-e261-4f5d-8cb5-73cb152a2fc3 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:18.953923 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cb52f-e261-4f5d-8cb5-73cb152a2fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:18.954196 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cb52f-e261-4f5d-8cb5-73cb152a2fc3 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:18.954937 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11cb52f-e261-4f5d-8cb5-73cb152a2fc3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:18.955242 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11cb52f-e261-4f5d-8cb5-73cb152a2fc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:18.956709 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11cb52f-e261-4f5d-8cb5-73cb152a2fc3 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:18.967050 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 192/386] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:18 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:18.980026 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728ae03-cc09-4514-ab93-ebfb5d4c28a1 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:19.087698 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:19.114081 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728ae03-cc09-4514-ab93-ebfb5d4c28a1 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:19.167779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a95e4e-0096-44a8-82ca-ccaa87b5d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:19.168903 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a95e4e-0096-44a8-82ca-ccaa87b5d55c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:19.169216 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a95e4e-0096-44a8-82ca-ccaa87b5d55c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:19.169449 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a95e4e-0096-44a8-82ca-ccaa87b5d55c None admin] PATH_INFO: `/v3/groups/a75cf136ec634d87b021d4b61bc3393f` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:19.172224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a95e4e-0096-44a8-82ca-ccaa87b5d55c None admin] RBAC: Authorizing `identity:get_group(group_id=a75cf136ec634d87b021d4b61bc3393f)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:19.173927 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a95e4e-0096-44a8-82ca-ccaa87b5d55c None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:19.175724 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 195/387] 10.222.0.121 () {56 vars in 1185 bytes} [Fri Aug 26 00:50:18 2022] GET /identity/v3/groups/a75cf136ec634d87b021d4b61bc3393f => generated 227 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:19.182601 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cb52f-e261-4f5d-8cb5-73cb152a2fc3 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:19.314008 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cb52f-e261-4f5d-8cb5-73cb152a2fc3 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:19.335255 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:19.367751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab7e78-ff9b-4565-8e8d-e0157af12aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:19.368430 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab7e78-ff9b-4565-8e8d-e0157af12aee None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:19.368720 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab7e78-ff9b-4565-8e8d-e0157af12aee None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:19.369005 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab7e78-ff9b-4565-8e8d-e0157af12aee None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:19.371461 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab7e78-ff9b-4565-8e8d-e0157af12aee None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:19.372995 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab7e78-ff9b-4565-8e8d-e0157af12aee None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:19.375143 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 193/388] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:19 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:19.381336 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a95e4e-0096-44a8-82ca-ccaa87b5d55c None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:19.432923 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab7e78-ff9b-4565-8e8d-e0157af12aee None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:19.619978 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a95e4e-0096-44a8-82ca-ccaa87b5d55c None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:19.667523 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab7e78-ff9b-4565-8e8d-e0157af12aee None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:19.706477 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e123b56-127a-43aa-9342-b9df7a7d76c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:19.709307 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e123b56-127a-43aa-9342-b9df7a7d76c7 None admin] REQUEST_METHOD: `PUT` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:19.710904 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e123b56-127a-43aa-9342-b9df7a7d76c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:19.711633 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e123b56-127a-43aa-9342-b9df7a7d76c7 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2/groups/a75cf136ec634d87b021d4b61bc3393f/roles/034b8b83b5934694bebbf0e19a81dc15` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:19.717164 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e123b56-127a-43aa-9342-b9df7a7d76c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc381ac268c74ac7aac2f833ee1437e2, group_id=a75cf136ec634d87b021d4b61bc3393f, role_id=034b8b83b5934694bebbf0e19a81dc15)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:19.719154 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e123b56-127a-43aa-9342-b9df7a7d76c7 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:19.746240 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0be605-a101-4e0a-9b19-d74d1f13a8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:19.747191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0be605-a101-4e0a-9b19-d74d1f13a8c9 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:19.747527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0be605-a101-4e0a-9b19-d74d1f13a8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:19.747818 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0be605-a101-4e0a-9b19-d74d1f13a8c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:19.759126 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0be605-a101-4e0a-9b19-d74d1f13a8c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-ec0be605-a101-4e0a-9b19-d74d1f13a8c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:19.765233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:19.766096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:19.767032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:19.767032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:19.767032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:19.767032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:19.767032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:19.767032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:19.767032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:19.767032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:19.767032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:19.767032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:19.767032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:19.767032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:19.767032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 194/389] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:50:19.774028 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0be605-a101-4e0a-9b19-d74d1f13a8c9 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:19.805734 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 196/390] 10.222.0.121 () {58 vars in 1447 bytes} [Fri Aug 26 00:50:19 2022] PUT /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2/groups/a75cf136ec634d87b021d4b61bc3393f/roles/034b8b83b5934694bebbf0e19a81dc15 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:50:19.824871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:19.915483 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0be605-a101-4e0a-9b19-d74d1f13a8c9 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:19.960473 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ca030-5f59-4d23-a3ca-16900083346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:19.961077 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ca030-5f59-4d23-a3ca-16900083346d None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:19.961360 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ca030-5f59-4d23-a3ca-16900083346d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:19.961631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ca030-5f59-4d23-a3ca-16900083346d None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:19.962394 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ca030-5f59-4d23-a3ca-16900083346d None admin] RBAC: Adding query filter params (name=member) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:19.962707 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ca030-5f59-4d23-a3ca-16900083346d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:19.964167 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ca030-5f59-4d23-a3ca-16900083346d None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:19.976046 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 195/391] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:50:19 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:19.984397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e123b56-127a-43aa-9342-b9df7a7d76c7 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:20.008737 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:20.169217 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e123b56-127a-43aa-9342-b9df7a7d76c7 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:20.213281 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d5ec4-6ddf-4cba-8e82-a1dce19c842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:20.213916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d5ec4-6ddf-4cba-8e82-a1dce19c842e None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:20.214199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d5ec4-6ddf-4cba-8e82-a1dce19c842e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:20.214474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d5ec4-6ddf-4cba-8e82-a1dce19c842e None admin] PATH_INFO: `/v3/groups/a75cf136ec634d87b021d4b61bc3393f` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:20.216008 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0ad27-bee2-4146-8cd6-19e747ef20f7 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:20.216298 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0ad27-bee2-4146-8cd6-19e747ef20f7 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:20.216580 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0ad27-bee2-4146-8cd6-19e747ef20f7 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:20.216723 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d5ec4-6ddf-4cba-8e82-a1dce19c842e None admin] RBAC: Authorizing `identity:get_group(group_id=a75cf136ec634d87b021d4b61bc3393f)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:20.218124 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d5ec4-6ddf-4cba-8e82-a1dce19c842e None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:20.220249 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 197/393] 10.222.0.121 () {56 vars in 1185 bytes} [Fri Aug 26 00:50:19 2022] GET /identity/v3/groups/a75cf136ec634d87b021d4b61bc3393f => generated 227 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:20.220400 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 196/393] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:20.224122 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665b845-f45f-4b30-b9dc-0ac6bff72ace None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:20.224392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665b845-f45f-4b30-b9dc-0ac6bff72ace None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:20.224699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665b845-f45f-4b30-b9dc-0ac6bff72ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:20.226576 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0ad27-bee2-4146-8cd6-19e747ef20f7 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:20.247637 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-6665b845-f45f-4b30-b9dc-0ac6bff72ace None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:20.249121 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-6665b845-f45f-4b30-b9dc-0ac6bff72ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:20.354858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0ad27-bee2-4146-8cd6-19e747ef20f7 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:20.359202 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:20.409704 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5b8fe-5549-4aa6-9cf6-673047802834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:20.410416 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5b8fe-5549-4aa6-9cf6-673047802834 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:20.410697 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5b8fe-5549-4aa6-9cf6-673047802834 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:20.410999 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5b8fe-5549-4aa6-9cf6-673047802834 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:20.412203 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5b8fe-5549-4aa6-9cf6-673047802834 None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:20.414437 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5b8fe-5549-4aa6-9cf6-673047802834 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:20.416681 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 197/394] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:20 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:20.423035 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5b8fe-5549-4aa6-9cf6-673047802834 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:20.478237 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 198/395] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:50:20.479518 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea06ca7-c6e8-4bf2-a841-fed684d4d3f0 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:20.479803 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea06ca7-c6e8-4bf2-a841-fed684d4d3f0 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:20.480082 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea06ca7-c6e8-4bf2-a841-fed684d4d3f0 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:20.486200 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 199/396] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:20.487666 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b398330-391f-4bde-9980-7dbfd7af01c1 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:20.487953 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b398330-391f-4bde-9980-7dbfd7af01c1 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:20.488225 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b398330-391f-4bde-9980-7dbfd7af01c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:20.506560 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:20.533869 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-4b398330-391f-4bde-9980-7dbfd7af01c1 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:20.535150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-4b398330-391f-4bde-9980-7dbfd7af01c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:20.572478 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5b8fe-5549-4aa6-9cf6-673047802834 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:20.651364 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dea2bc-7de3-4788-b69a-85849c7d432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:20.652170 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dea2bc-7de3-4788-b69a-85849c7d432f None admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:20.652972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dea2bc-7de3-4788-b69a-85849c7d432f None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:20.653431 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dea2bc-7de3-4788-b69a-85849c7d432f None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2/groups/a75cf136ec634d87b021d4b61bc3393f/roles/8acc6a2016c149a0b80cf3c56b5ae91a` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:20.659092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dea2bc-7de3-4788-b69a-85849c7d432f None admin] RBAC: Authorizing `identity:create_grant(project_id=bc381ac268c74ac7aac2f833ee1437e2, group_id=a75cf136ec634d87b021d4b61bc3393f, role_id=8acc6a2016c149a0b80cf3c56b5ae91a)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:20.661322 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dea2bc-7de3-4788-b69a-85849c7d432f None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:20.678403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 200/397] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:50:20.789198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 198/398] 10.222.0.121 () {58 vars in 1447 bytes} [Fri Aug 26 00:50:20 2022] PUT /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2/groups/a75cf136ec634d87b021d4b61bc3393f/roles/8acc6a2016c149a0b80cf3c56b5ae91a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:50:20.869096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b398330-391f-4bde-9980-7dbfd7af01c1 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:21.012377 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b398330-391f-4bde-9980-7dbfd7af01c1 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:21.029189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fc13f-f5fc-4ac0-a6ba-648a84db8f2e None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:21.029524 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fc13f-f5fc-4ac0-a6ba-648a84db8f2e None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:21.029783 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fc13f-f5fc-4ac0-a6ba-648a84db8f2e None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:21.031314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 199/399] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:50:21.036357 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f4326-753e-4fc9-8d11-ca4c7210a041 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:21.036701 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f4326-753e-4fc9-8d11-ca4c7210a041 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:21.036922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f4326-753e-4fc9-8d11-ca4c7210a041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:21.058207 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-bc7f4326-753e-4fc9-8d11-ca4c7210a041 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:21.060160 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-bc7f4326-753e-4fc9-8d11-ca4c7210a041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:21.064953 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10475167-c98f-480e-9e1f-cdfb1f50c987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:21.065917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10475167-c98f-480e-9e1f-cdfb1f50c987 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:21.066380 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10475167-c98f-480e-9e1f-cdfb1f50c987 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:21.066852 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10475167-c98f-480e-9e1f-cdfb1f50c987 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:21.082412 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:21.085601 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10475167-c98f-480e-9e1f-cdfb1f50c987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-10475167-c98f-480e-9e1f-cdfb1f50c987 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:21.093071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:21.095553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:21.096327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:21.096327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:21.096327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:21.096327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:21.096327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:21.096327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:21.096327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:21.096327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:21.096327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:21.096327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:21.096327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:50:21.096327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:21.103141 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 201/400] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:50:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:50:21.103807 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:21.103913 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10475167-c98f-480e-9e1f-cdfb1f50c987 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:21.166072 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 200/401] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:50:21.167561 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f4326-753e-4fc9-8d11-ca4c7210a041 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:21.312500 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f4326-753e-4fc9-8d11-ca4c7210a041 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:21.352411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff683d65-269d-4321-b259-cbf46e8405d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:21.353153 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff683d65-269d-4321-b259-cbf46e8405d9 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:21.353521 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff683d65-269d-4321-b259-cbf46e8405d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:21.353867 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff683d65-269d-4321-b259-cbf46e8405d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:21.354613 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff683d65-269d-4321-b259-cbf46e8405d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:21.355005 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff683d65-269d-4321-b259-cbf46e8405d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:21.357064 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff683d65-269d-4321-b259-cbf46e8405d9 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:21.366726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 201/402] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:21 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:21.373691 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff683d65-269d-4321-b259-cbf46e8405d9 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:21.380994 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10475167-c98f-480e-9e1f-cdfb1f50c987 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:21.405593 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:21.491451 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff683d65-269d-4321-b259-cbf46e8405d9 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:21.503617 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e7ec4-d75a-43ff-9642-1cc2fb77762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:21.504280 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e7ec4-d75a-43ff-9642-1cc2fb77762a None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:21.504562 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e7ec4-d75a-43ff-9642-1cc2fb77762a None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:21.504835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e7ec4-d75a-43ff-9642-1cc2fb77762a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:21.530492 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b1640-3e99-4bfd-86b2-e318cfd5305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:21.531323 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b1640-3e99-4bfd-86b2-e318cfd5305b None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:21.531608 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b1640-3e99-4bfd-86b2-e318cfd5305b None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:21.531889 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b1640-3e99-4bfd-86b2-e318cfd5305b None admin] PATH_INFO: `/v3/groups/a75cf136ec634d87b021d4b61bc3393f` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:21.533066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b1640-3e99-4bfd-86b2-e318cfd5305b None admin] RBAC: Authorizing `identity:get_group(group_id=a75cf136ec634d87b021d4b61bc3393f)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:21.534551 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b1640-3e99-4bfd-86b2-e318cfd5305b None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:21.536532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 202/403] 10.222.0.121 () {56 vars in 1185 bytes} [Fri Aug 26 00:50:21 2022] GET /identity/v3/groups/a75cf136ec634d87b021d4b61bc3393f => generated 227 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:21.539907 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e7ec4-d75a-43ff-9642-1cc2fb77762a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:21.541992 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b1640-3e99-4bfd-86b2-e318cfd5305b None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-0b8e7ec4-d75a-43ff-9642-1cc2fb77762a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:21.545350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:21.546241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:21.547170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:21.547170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:21.547170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:21.547170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:21.547170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:21.547170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:21.547170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:21.547170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:21.547170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:21.547170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:21.547170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:21.547170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:21.559087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 202/404] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:21.563334 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e7ec4-d75a-43ff-9642-1cc2fb77762a None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:21.648770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:21.656528 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:21.659627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b1640-3e99-4bfd-86b2-e318cfd5305b None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:21.713709 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e7ec4-d75a-43ff-9642-1cc2fb77762a None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:21.717068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac4906-a7ae-4dc3-8e4e-26533d9143a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:21.717822 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac4906-a7ae-4dc3-8e4e-26533d9143a5 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:21.719133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac4906-a7ae-4dc3-8e4e-26533d9143a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:21.719629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac4906-a7ae-4dc3-8e4e-26533d9143a5 None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:21.723138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac4906-a7ae-4dc3-8e4e-26533d9143a5 None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:21.725951 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac4906-a7ae-4dc3-8e4e-26533d9143a5 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:21.729753 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 203/405] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:21 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:21.732438 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac4906-a7ae-4dc3-8e4e-26533d9143a5 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:21.764604 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a9cd2-883d-478f-86fd-26cbd4178dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:21.765747 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a9cd2-883d-478f-86fd-26cbd4178dca None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:21.766352 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a9cd2-883d-478f-86fd-26cbd4178dca None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:21.766807 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a9cd2-883d-478f-86fd-26cbd4178dca None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:21.767708 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a9cd2-883d-478f-86fd-26cbd4178dca None admin] RBAC: Adding query filter params (name=member) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:21.768192 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a9cd2-883d-478f-86fd-26cbd4178dca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:21.769999 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a9cd2-883d-478f-86fd-26cbd4178dca None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:21.786980 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 203/406] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:50:21 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:21.786980 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a9cd2-883d-478f-86fd-26cbd4178dca None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:21.892724 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac4906-a7ae-4dc3-8e4e-26533d9143a5 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:21.920924 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a9cd2-883d-478f-86fd-26cbd4178dca None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:21.938161 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3cb2b-5a79-4bc3-a0a6-3b6224bef3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:21.939652 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3cb2b-5a79-4bc3-a0a6-3b6224bef3a8 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:21.940153 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3cb2b-5a79-4bc3-a0a6-3b6224bef3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:21.940633 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3cb2b-5a79-4bc3-a0a6-3b6224bef3a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:21.951328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:21.956333 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3cb2b-5a79-4bc3-a0a6-3b6224bef3a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-68d3cb2b-5a79-4bc3-a0a6-3b6224bef3a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:21.963771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:21.966200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:21.967597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:21.967597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:21.967597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:21.967597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:21.967597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:21.967597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:21.967597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:21.967597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:21.967597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:21.967597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:21.967597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:50:21.967597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:21.967597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 204/407] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:50:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:21.969551 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3cb2b-5a79-4bc3-a0a6-3b6224bef3a8 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:21.992030 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935e19a-1923-4207-83a6-0b783245deb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:21.993266 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935e19a-1923-4207-83a6-0b783245deb9 None admin] REQUEST_METHOD: `PUT` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:21.993655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935e19a-1923-4207-83a6-0b783245deb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:21.994034 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935e19a-1923-4207-83a6-0b783245deb9 None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5/groups/a75cf136ec634d87b021d4b61bc3393f/roles/034b8b83b5934694bebbf0e19a81dc15` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:21.997697 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935e19a-1923-4207-83a6-0b783245deb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=feb83e414d37430ab448d27e7af47df5, group_id=a75cf136ec634d87b021d4b61bc3393f, role_id=034b8b83b5934694bebbf0e19a81dc15)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:21.999879 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935e19a-1923-4207-83a6-0b783245deb9 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:22.012286 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:22.139129 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 204/408] 10.222.0.121 () {58 vars in 1447 bytes} [Fri Aug 26 00:50:21 2022] PUT /identity/v3/projects/feb83e414d37430ab448d27e7af47df5/groups/a75cf136ec634d87b021d4b61bc3393f/roles/034b8b83b5934694bebbf0e19a81dc15 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:50:22.140996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935e19a-1923-4207-83a6-0b783245deb9 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:22.149019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3cb2b-5a79-4bc3-a0a6-3b6224bef3a8 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:22.232526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ff552-d562-4ace-996c-5339e085dc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:22.233272 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ff552-d562-4ace-996c-5339e085dc7a None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:22.233561 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ff552-d562-4ace-996c-5339e085dc7a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:22.233834 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ff552-d562-4ace-996c-5339e085dc7a None admin] PATH_INFO: `/v3/groups/a75cf136ec634d87b021d4b61bc3393f` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:22.238628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ff552-d562-4ace-996c-5339e085dc7a None admin] RBAC: Authorizing `identity:get_group(group_id=a75cf136ec634d87b021d4b61bc3393f)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:22.240262 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ff552-d562-4ace-996c-5339e085dc7a None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:22.242059 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 205/409] 10.222.0.121 () {56 vars in 1185 bytes} [Fri Aug 26 00:50:21 2022] GET /identity/v3/groups/a75cf136ec634d87b021d4b61bc3393f => generated 227 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:22.247957 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ff552-d562-4ace-996c-5339e085dc7a None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:22.285833 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935e19a-1923-4207-83a6-0b783245deb9 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:22.348761 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee57de1-6da3-451d-a481-f84c0b67dc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:22.352089 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee57de1-6da3-451d-a481-f84c0b67dc23 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:22.352792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee57de1-6da3-451d-a481-f84c0b67dc23 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:22.354150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee57de1-6da3-451d-a481-f84c0b67dc23 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:22.356298 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee57de1-6da3-451d-a481-f84c0b67dc23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:22.359389 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee57de1-6da3-451d-a481-f84c0b67dc23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:22.364852 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee57de1-6da3-451d-a481-f84c0b67dc23 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:22.394165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 205/410] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:22 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:22.400878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee57de1-6da3-451d-a481-f84c0b67dc23 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:22.482623 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:22.498398 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ff552-d562-4ace-996c-5339e085dc7a None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:22.505496 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:22.546595 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0409cbd-6cbd-4dd0-8ed1-12a8e5006ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:22.547991 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0409cbd-6cbd-4dd0-8ed1-12a8e5006ce1 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:22.548526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0409cbd-6cbd-4dd0-8ed1-12a8e5006ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:22.549013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0409cbd-6cbd-4dd0-8ed1-12a8e5006ce1 None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:22.550479 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0409cbd-6cbd-4dd0-8ed1-12a8e5006ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:22.552495 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0409cbd-6cbd-4dd0-8ed1-12a8e5006ce1 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:22.555486 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 206/411] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:22 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:22.563070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0409cbd-6cbd-4dd0-8ed1-12a8e5006ce1 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:22.604107 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee57de1-6da3-451d-a481-f84c0b67dc23 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:22.645093 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28570b2-e5f2-444c-aa43-25683000bd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:22.645792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28570b2-e5f2-444c-aa43-25683000bd4c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:22.646079 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28570b2-e5f2-444c-aa43-25683000bd4c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:22.646354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28570b2-e5f2-444c-aa43-25683000bd4c None admin] PATH_INFO: `/v3/groups/b50dd6e5862e49c5973694870b25abf8` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:22.647815 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28570b2-e5f2-444c-aa43-25683000bd4c None admin] RBAC: Authorizing `identity:get_group(group_id=b50dd6e5862e49c5973694870b25abf8)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:22.649507 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28570b2-e5f2-444c-aa43-25683000bd4c None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:22.651824 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 206/412] 10.222.0.121 () {56 vars in 1185 bytes} [Fri Aug 26 00:50:22 2022] GET /identity/v3/groups/b50dd6e5862e49c5973694870b25abf8 => generated 230 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:22.657982 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d352dcd-6ccf-4341-89fd-e7957bb5c3e7 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:22.657982 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d352dcd-6ccf-4341-89fd-e7957bb5c3e7 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:22.657982 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d352dcd-6ccf-4341-89fd-e7957bb5c3e7 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:22.657982 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 207/413] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:22.659593 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d352dcd-6ccf-4341-89fd-e7957bb5c3e7 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:22.693315 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0409cbd-6cbd-4dd0-8ed1-12a8e5006ce1 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:22.736182 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd656a-31af-49eb-875d-b6d24948474e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:22.737615 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd656a-31af-49eb-875d-b6d24948474e None admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:22.738200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd656a-31af-49eb-875d-b6d24948474e None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:22.738673 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd656a-31af-49eb-875d-b6d24948474e None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5/groups/a75cf136ec634d87b021d4b61bc3393f/roles/8acc6a2016c149a0b80cf3c56b5ae91a` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:22.741141 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd656a-31af-49eb-875d-b6d24948474e None admin] RBAC: Authorizing `identity:create_grant(project_id=feb83e414d37430ab448d27e7af47df5, group_id=a75cf136ec634d87b021d4b61bc3393f, role_id=8acc6a2016c149a0b80cf3c56b5ae91a)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:22.743183 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd656a-31af-49eb-875d-b6d24948474e None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:22.790565 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d352dcd-6ccf-4341-89fd-e7957bb5c3e7 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:22.799953 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:22.838665 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 207/414] 10.222.0.121 () {58 vars in 1447 bytes} [Fri Aug 26 00:50:22 2022] PUT /identity/v3/projects/feb83e414d37430ab448d27e7af47df5/groups/a75cf136ec634d87b021d4b61bc3393f/roles/8acc6a2016c149a0b80cf3c56b5ae91a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:50:22.838665 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591143e-c792-4133-86d0-64e16a90c37d None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:22.838665 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591143e-c792-4133-86d0-64e16a90c37d None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:22.838665 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591143e-c792-4133-86d0-64e16a90c37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:22.851860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac14bca-8758-4c43-ab0a-59f835b7773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:22.852532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac14bca-8758-4c43-ab0a-59f835b7773c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:22.852816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac14bca-8758-4c43-ab0a-59f835b7773c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:22.853093 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac14bca-8758-4c43-ab0a-59f835b7773c None admin] PATH_INFO: `/v3/projects/e4454f1e3bf94358ad484413a3205af0` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:22.860239 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac14bca-8758-4c43-ab0a-59f835b7773c None admin] RBAC: Authorizing `identity:get_project(project_id=e4454f1e3bf94358ad484413a3205af0)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:22.861818 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac14bca-8758-4c43-ab0a-59f835b7773c None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:22.864125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 208/415] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:22 2022] GET /identity/v3/projects/e4454f1e3bf94358ad484413a3205af0 => generated 345 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:22.872073 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac14bca-8758-4c43-ab0a-59f835b7773c None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:22.880432 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-d591143e-c792-4133-86d0-64e16a90c37d None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:22.881717 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-d591143e-c792-4133-86d0-64e16a90c37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:22.904991 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:23.027946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 208/416] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:23.059336 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac14bca-8758-4c43-ab0a-59f835b7773c None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:23.108497 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207df642-45b8-4a23-a2f0-f017f4aea03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:23.109696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207df642-45b8-4a23-a2f0-f017f4aea03f None admin] REQUEST_METHOD: `PUT` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:23.110191 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207df642-45b8-4a23-a2f0-f017f4aea03f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:23.110681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207df642-45b8-4a23-a2f0-f017f4aea03f None admin] PATH_INFO: `/v3/projects/e4454f1e3bf94358ad484413a3205af0/groups/b50dd6e5862e49c5973694870b25abf8/roles/e73a8fc0684c4f6083a71ea9a85c7298` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:23.114597 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207df642-45b8-4a23-a2f0-f017f4aea03f None admin] RBAC: Authorizing `identity:create_grant(project_id=e4454f1e3bf94358ad484413a3205af0, group_id=b50dd6e5862e49c5973694870b25abf8, role_id=e73a8fc0684c4f6083a71ea9a85c7298)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:23.117527 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207df642-45b8-4a23-a2f0-f017f4aea03f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:23.221379 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 209/417] 10.222.0.121 () {58 vars in 1447 bytes} [Fri Aug 26 00:50:22 2022] PUT /identity/v3/projects/e4454f1e3bf94358ad484413a3205af0/groups/b50dd6e5862e49c5973694870b25abf8/roles/e73a8fc0684c4f6083a71ea9a85c7298 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:50:23.442221 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591143e-c792-4133-86d0-64e16a90c37d None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:23.617590 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591143e-c792-4133-86d0-64e16a90c37d None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:23.665671 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb64b5-30a2-46dc-be3c-3b152b96803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:23.666336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb64b5-30a2-46dc-be3c-3b152b96803f None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:23.666615 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb64b5-30a2-46dc-be3c-3b152b96803f None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:23.666931 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb64b5-30a2-46dc-be3c-3b152b96803f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:23.683762 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb64b5-30a2-46dc-be3c-3b152b96803f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-33bb64b5-30a2-46dc-be3c-3b152b96803f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:23.688815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:23.689789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:23.691095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:23.691095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:23.691095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:23.691095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:23.691095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:23.691095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:23.691095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:23.691095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:23.691095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:23.691095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:23.691095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:50:23.691095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:23.691095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 209/418] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:50:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:23.697501 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207df642-45b8-4a23-a2f0-f017f4aea03f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:23.758415 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:23.879789 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207df642-45b8-4a23-a2f0-f017f4aea03f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:23.927160 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df343b-6ac5-47bf-813c-8586fa9cad80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:23.927785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df343b-6ac5-47bf-813c-8586fa9cad80 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:23.928068 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df343b-6ac5-47bf-813c-8586fa9cad80 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:23.928347 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df343b-6ac5-47bf-813c-8586fa9cad80 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:23.929022 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df343b-6ac5-47bf-813c-8586fa9cad80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:23.929326 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df343b-6ac5-47bf-813c-8586fa9cad80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:23.930753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df343b-6ac5-47bf-813c-8586fa9cad80 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:23.941305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabcad2-f799-438c-9401-295dfe05192c None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:23.946312 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 210/419] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:23 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:23.946621 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabcad2-f799-438c-9401-295dfe05192c None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:23.948139 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df343b-6ac5-47bf-813c-8586fa9cad80 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:23.950771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabcad2-f799-438c-9401-295dfe05192c None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:23.955127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 210/420] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:23 2022] GET /identity => generated 271 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:50:23.961241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6893e4a-50b2-44e4-8e77-0f1cd4723d37 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:23.962198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6893e4a-50b2-44e4-8e77-0f1cd4723d37 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:23.963048 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6893e4a-50b2-44e4-8e77-0f1cd4723d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:24.001333 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:24.012076 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-a6893e4a-50b2-44e4-8e77-0f1cd4723d37 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:24.029438 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-a6893e4a-50b2-44e4-8e77-0f1cd4723d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:24.139413 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:24.155600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df343b-6ac5-47bf-813c-8586fa9cad80 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:24.200792 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 211/421] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:50:24.247095 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449261a-6b37-4da1-bac1-49c8dc074e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:24.248092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449261a-6b37-4da1-bac1-49c8dc074e8c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:24.248507 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449261a-6b37-4da1-bac1-49c8dc074e8c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:24.249026 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449261a-6b37-4da1-bac1-49c8dc074e8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:24.431333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449261a-6b37-4da1-bac1-49c8dc074e8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:24.432762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449261a-6b37-4da1-bac1-49c8dc074e8c None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:24.564255 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 211/422] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:23 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:24.564775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:24.571871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6893e4a-50b2-44e4-8e77-0f1cd4723d37 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:24.714392 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6893e4a-50b2-44e4-8e77-0f1cd4723d37 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:24.764378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4977f1-64f6-44ba-8235-089a2e7fd7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:24.765043 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4977f1-64f6-44ba-8235-089a2e7fd7f9 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:24.765322 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4977f1-64f6-44ba-8235-089a2e7fd7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:24.765593 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4977f1-64f6-44ba-8235-089a2e7fd7f9 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:24.766923 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4977f1-64f6-44ba-8235-089a2e7fd7f9 None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:24.768453 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4977f1-64f6-44ba-8235-089a2e7fd7f9 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:24.770564 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 212/423] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:24 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:24.777060 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449261a-6b37-4da1-bac1-49c8dc074e8c None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:24.904655 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4977f1-64f6-44ba-8235-089a2e7fd7f9 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:24.910316 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:25.052173 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449261a-6b37-4da1-bac1-49c8dc074e8c None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:25.123432 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4024c-27ac-47c0-ba55-4a24848fa3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:25.124505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4024c-27ac-47c0-ba55-4a24848fa3db None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:25.124998 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4024c-27ac-47c0-ba55-4a24848fa3db None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:25.125482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4024c-27ac-47c0-ba55-4a24848fa3db None admin] PATH_INFO: `/v3/groups/a75cf136ec634d87b021d4b61bc3393f` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:25.128028 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4024c-27ac-47c0-ba55-4a24848fa3db None admin] RBAC: Authorizing `identity:get_group(group_id=a75cf136ec634d87b021d4b61bc3393f)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:25.130859 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4024c-27ac-47c0-ba55-4a24848fa3db None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:25.134312 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 212/424] 10.222.0.121 () {56 vars in 1185 bytes} [Fri Aug 26 00:50:24 2022] GET /identity/v3/groups/a75cf136ec634d87b021d4b61bc3393f => generated 227 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:25.141080 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6a80d-96ca-46e6-9337-c7b6c4fc6c25 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:25.141569 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6a80d-96ca-46e6-9337-c7b6c4fc6c25 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:25.142121 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6a80d-96ca-46e6-9337-c7b6c4fc6c25 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:25.144884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 213/425] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:25 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:50:25.152786 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6a80d-96ca-46e6-9337-c7b6c4fc6c25 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:25.158017 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4977f1-64f6-44ba-8235-089a2e7fd7f9 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:25.199721 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62420a-ea91-47d7-baae-419e6e578f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:25.200432 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62420a-ea91-47d7-baae-419e6e578f08 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:25.200955 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62420a-ea91-47d7-baae-419e6e578f08 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:25.201244 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62420a-ea91-47d7-baae-419e6e578f08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:25.213826 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62420a-ea91-47d7-baae-419e6e578f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-3d62420a-ea91-47d7-baae-419e6e578f08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:25.219620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:25.220569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:25.221799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:25.221799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:25.221799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:25.221799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:25.221799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:25.221799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:25.221799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:25.221799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:25.221799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:25.221799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:25.221799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:25.221799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:25.221799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 213/426] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:50:25.222467 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a25c50-7bff-473e-8b4b-49572e3f2a02 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:25.222467 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a25c50-7bff-473e-8b4b-49572e3f2a02 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:25.222618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a25c50-7bff-473e-8b4b-49572e3f2a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:25.244847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-73a25c50-7bff-473e-8b4b-49572e3f2a02 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:25.246684 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-73a25c50-7bff-473e-8b4b-49572e3f2a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:25.283110 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:25.331286 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:25.346166 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 214/427] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:25.346166 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a25c50-7bff-473e-8b4b-49572e3f2a02 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:25.388190 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6a80d-96ca-46e6-9337-c7b6c4fc6c25 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:25.478476 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40669b92-5b05-4e25-b05e-cfe960feb773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:25.479171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40669b92-5b05-4e25-b05e-cfe960feb773 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:25.479452 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40669b92-5b05-4e25-b05e-cfe960feb773 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:25.479731 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40669b92-5b05-4e25-b05e-cfe960feb773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:25.480550 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40669b92-5b05-4e25-b05e-cfe960feb773 None admin] RBAC: Adding query filter params (group.id=a75cf136ec634d87b021d4b61bc3393f, role.id=034b8b83b5934694bebbf0e19a81dc15, scope.project.id=bc381ac268c74ac7aac2f833ee1437e2) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:25.480858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40669b92-5b05-4e25-b05e-cfe960feb773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:25.482334 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40669b92-5b05-4e25-b05e-cfe960feb773 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:25.497254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a25c50-7bff-473e-8b4b-49572e3f2a02 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:25.506607 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 214/428] 10.222.0.121 () {56 vars in 1381 bytes} [Fri Aug 26 00:50:25 2022] GET /identity/v3/role_assignments?group.id=a75cf136ec634d87b021d4b61bc3393f&scope.project.id=bc381ac268c74ac7aac2f833ee1437e2&role.id=034b8b83b5934694bebbf0e19a81dc15 => generated 613 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:25.540949 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7fac0-5cef-447c-acaf-9ff89bd3d30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:25.541605 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7fac0-5cef-447c-acaf-9ff89bd3d30d None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:25.541900 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7fac0-5cef-447c-acaf-9ff89bd3d30d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:25.542647 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7fac0-5cef-447c-acaf-9ff89bd3d30d None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:25.543409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7fac0-5cef-447c-acaf-9ff89bd3d30d None admin] RBAC: Adding query filter params (name=member) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:25.543709 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7fac0-5cef-447c-acaf-9ff89bd3d30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:25.545149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7fac0-5cef-447c-acaf-9ff89bd3d30d None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:25.558988 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 215/429] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:50:25 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:25.562370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40669b92-5b05-4e25-b05e-cfe960feb773 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:25.693763 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40669b92-5b05-4e25-b05e-cfe960feb773 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:25.730487 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:25.743004 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227e0b3-8837-439d-8dad-97546015b7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:25.743642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227e0b3-8837-439d-8dad-97546015b7f5 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:25.743920 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227e0b3-8837-439d-8dad-97546015b7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:25.744193 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227e0b3-8837-439d-8dad-97546015b7f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:25.883439 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227e0b3-8837-439d-8dad-97546015b7f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:25.885668 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227e0b3-8837-439d-8dad-97546015b7f5 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:25.929500 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7fac0-5cef-447c-acaf-9ff89bd3d30d None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:26.037487 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 215/430] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:26.047084 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227e0b3-8837-439d-8dad-97546015b7f5 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:26.080101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:26.087286 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:26.186185 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7fac0-5cef-447c-acaf-9ff89bd3d30d None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:26.251691 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227e0b3-8837-439d-8dad-97546015b7f5 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:26.271660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648776b1-347a-429b-8671-3a0d7af2035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:26.273368 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648776b1-347a-429b-8671-3a0d7af2035a None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:26.274993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648776b1-347a-429b-8671-3a0d7af2035a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:26.275634 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648776b1-347a-429b-8671-3a0d7af2035a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:26.300209 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648776b1-347a-429b-8671-3a0d7af2035a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-648776b1-347a-429b-8671-3a0d7af2035a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:26.318365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:26.320532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:26.322340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:26.322340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:26.322340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:26.322340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:26.322340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:26.322340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:26.322340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:26.322340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:26.322340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:26.322340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:26.322340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:50:26.322340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:26.327566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 216/431] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:50:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:50:26.333946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648776b1-347a-429b-8671-3a0d7af2035a None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:26.344653 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c028ec-8aad-457b-9934-c903283571d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:26.345741 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c028ec-8aad-457b-9934-c903283571d6 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:26.346230 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c028ec-8aad-457b-9934-c903283571d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:26.346718 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c028ec-8aad-457b-9934-c903283571d6 None admin] PATH_INFO: `/v3/projects/bc381ac268c74ac7aac2f833ee1437e2` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:26.349051 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c028ec-8aad-457b-9934-c903283571d6 None admin] RBAC: Authorizing `identity:get_project(project_id=bc381ac268c74ac7aac2f833ee1437e2)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:26.351923 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c028ec-8aad-457b-9934-c903283571d6 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:26.362763 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 216/432] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:26 2022] GET /identity/v3/projects/bc381ac268c74ac7aac2f833ee1437e2 => generated 299 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:26.364888 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c028ec-8aad-457b-9934-c903283571d6 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:26.521212 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:26.528013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648776b1-347a-429b-8671-3a0d7af2035a None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:26.530092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c028ec-8aad-457b-9934-c903283571d6 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:26.554254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:26.586329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb33da-2ef0-4617-8449-3808300c2ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:26.587364 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb33da-2ef0-4617-8449-3808300c2ad8 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:26.587828 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb33da-2ef0-4617-8449-3808300c2ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:26.588294 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb33da-2ef0-4617-8449-3808300c2ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:26.589525 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb33da-2ef0-4617-8449-3808300c2ad8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:26.590048 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb33da-2ef0-4617-8449-3808300c2ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:26.591988 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655d2c7-1cc4-4bf7-88e8-54035bfce7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:26.592577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb33da-2ef0-4617-8449-3808300c2ad8 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:26.592977 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655d2c7-1cc4-4bf7-88e8-54035bfce7f9 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:26.593410 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655d2c7-1cc4-4bf7-88e8-54035bfce7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:26.593858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655d2c7-1cc4-4bf7-88e8-54035bfce7f9 None admin] PATH_INFO: `/v3/groups/a75cf136ec634d87b021d4b61bc3393f` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:26.596027 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655d2c7-1cc4-4bf7-88e8-54035bfce7f9 None admin] RBAC: Authorizing `identity:get_group(group_id=a75cf136ec634d87b021d4b61bc3393f)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:26.598159 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655d2c7-1cc4-4bf7-88e8-54035bfce7f9 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:26.601129 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 217/433] 10.222.0.121 () {56 vars in 1185 bytes} [Fri Aug 26 00:50:26 2022] GET /identity/v3/groups/a75cf136ec634d87b021d4b61bc3393f => generated 227 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:26.603007 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be69a5-843e-468e-98eb-60fced39ad93 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:26.603461 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be69a5-843e-468e-98eb-60fced39ad93 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:26.603899 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be69a5-843e-468e-98eb-60fced39ad93 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:26.606915 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 218/434] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:26 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:26.609261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 217/435] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:26 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:26.610764 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb33da-2ef0-4617-8449-3808300c2ad8 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:26.615739 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa66a-7a93-4001-8ccd-a9fe6463fa1d None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:26.616192 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa66a-7a93-4001-8ccd-a9fe6463fa1d None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:26.616657 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa66a-7a93-4001-8ccd-a9fe6463fa1d None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:26.618411 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 219/436] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:26 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:26.619852 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538db037-ae43-424a-b965-59b61d38c2a2 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:26.620411 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538db037-ae43-424a-b965-59b61d38c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:26.620818 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538db037-ae43-424a-b965-59b61d38c2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:26.642106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-538db037-ae43-424a-b965-59b61d38c2a2 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:26.643548 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-538db037-ae43-424a-b965-59b61d38c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:26.738029 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 220/437] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:26.739350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538db037-ae43-424a-b965-59b61d38c2a2 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:26.755637 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb33da-2ef0-4617-8449-3808300c2ad8 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:26.801818 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df32fe-9e14-48db-a95d-b4d2c1577d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:26.802790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df32fe-9e14-48db-a95d-b4d2c1577d4f None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:26.803261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df32fe-9e14-48db-a95d-b4d2c1577d4f None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:26.803681 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df32fe-9e14-48db-a95d-b4d2c1577d4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:26.804824 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df32fe-9e14-48db-a95d-b4d2c1577d4f None admin] RBAC: Adding query filter params (group.id=a75cf136ec634d87b021d4b61bc3393f, role.id=8acc6a2016c149a0b80cf3c56b5ae91a, scope.project.id=bc381ac268c74ac7aac2f833ee1437e2) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:26.805275 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df32fe-9e14-48db-a95d-b4d2c1577d4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:26.807188 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df32fe-9e14-48db-a95d-b4d2c1577d4f None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:26.815415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 218/438] 10.222.0.121 () {56 vars in 1381 bytes} [Fri Aug 26 00:50:26 2022] GET /identity/v3/role_assignments?group.id=a75cf136ec634d87b021d4b61bc3393f&scope.project.id=bc381ac268c74ac7aac2f833ee1437e2&role.id=8acc6a2016c149a0b80cf3c56b5ae91a => generated 613 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:26.825800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43df77-ce7a-48a5-bded-8d072f730a21 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:26.826564 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43df77-ce7a-48a5-bded-8d072f730a21 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:26.827213 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43df77-ce7a-48a5-bded-8d072f730a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:26.861810 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-1a43df77-ce7a-48a5-bded-8d072f730a21 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:26.864416 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-1a43df77-ce7a-48a5-bded-8d072f730a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:26.942227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:26.959883 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:26.975005 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538db037-ae43-424a-b965-59b61d38c2a2 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:27.005241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 219/439] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:27.051510 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e77eb-bd5e-4cb5-8188-5e53c7979a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:27.052693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e77eb-bd5e-4cb5-8188-5e53c7979a5a None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:27.053116 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e77eb-bd5e-4cb5-8188-5e53c7979a5a None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:27.053757 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e77eb-bd5e-4cb5-8188-5e53c7979a5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:27.157204 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43df77-ce7a-48a5-bded-8d072f730a21 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:27.159895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e77eb-bd5e-4cb5-8188-5e53c7979a5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:27.161616 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e77eb-bd5e-4cb5-8188-5e53c7979a5a None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:27.296840 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:27.307724 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 221/440] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:26 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:27.317544 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e77eb-bd5e-4cb5-8188-5e53c7979a5a None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:27.383223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43df77-ce7a-48a5-bded-8d072f730a21 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:27.433406 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec38fd-1586-463e-9427-31f0a22b118a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:27.433776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec38fd-1586-463e-9427-31f0a22b118a None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:27.434136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec38fd-1586-463e-9427-31f0a22b118a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:27.435014 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec38fd-1586-463e-9427-31f0a22b118a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:27.457714 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec38fd-1586-463e-9427-31f0a22b118a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-ccec38fd-1586-463e-9427-31f0a22b118a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:27.466775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:27.467743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:27.472015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:27.472015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:27.472015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:27.472015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:27.472015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:27.472015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:27.472015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:27.472015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:27.472015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:27.472015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:27.472015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:50:27.472015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:27.472015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 220/441] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:50:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:27.472015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec38fd-1586-463e-9427-31f0a22b118a None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:27.491302 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e77eb-bd5e-4cb5-8188-5e53c7979a5a None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:27.525155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:27.559451 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77216c1-5578-4cdf-9c1a-79bb693f5392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:27.560336 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77216c1-5578-4cdf-9c1a-79bb693f5392 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:27.560821 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77216c1-5578-4cdf-9c1a-79bb693f5392 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:27.561089 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77216c1-5578-4cdf-9c1a-79bb693f5392 None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:27.562623 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77216c1-5578-4cdf-9c1a-79bb693f5392 None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:27.564197 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77216c1-5578-4cdf-9c1a-79bb693f5392 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:27.567767 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 222/442] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:27 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:27.567767 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77216c1-5578-4cdf-9c1a-79bb693f5392 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:27.639297 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec38fd-1586-463e-9427-31f0a22b118a None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:27.675415 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:27.704753 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c19df5-33bf-4b69-ab90-d99a6b579d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:27.705756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c19df5-33bf-4b69-ab90-d99a6b579d94 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:27.706127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c19df5-33bf-4b69-ab90-d99a6b579d94 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:27.706542 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c19df5-33bf-4b69-ab90-d99a6b579d94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:27.728538 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c19df5-33bf-4b69-ab90-d99a6b579d94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-61c19df5-33bf-4b69-ab90-d99a6b579d94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:27.733977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:27.735852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:27.738299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:27.738299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:27.738299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:27.738299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:27.738299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:27.738299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:27.738299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:27.738299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:27.738299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:27.738299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:27.738299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:50:27.738299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:27.738299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 221/443] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:27.738299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c19df5-33bf-4b69-ab90-d99a6b579d94 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:27.749209 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77216c1-5578-4cdf-9c1a-79bb693f5392 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:27.793077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19e872-19fc-458e-93a4-806dcdc31a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:27.793810 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19e872-19fc-458e-93a4-806dcdc31a7b None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:27.794159 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19e872-19fc-458e-93a4-806dcdc31a7b None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:27.794504 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19e872-19fc-458e-93a4-806dcdc31a7b None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:27.795395 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19e872-19fc-458e-93a4-806dcdc31a7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:27.795815 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19e872-19fc-458e-93a4-806dcdc31a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:27.797340 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19e872-19fc-458e-93a4-806dcdc31a7b None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:27.807724 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 223/444] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:27 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:27.809605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19e872-19fc-458e-93a4-806dcdc31a7b None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:27.869961 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:27.882081 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c19df5-33bf-4b69-ab90-d99a6b579d94 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:27.928733 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147433d-9038-4cad-bc26-f525ec67ddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:27.929773 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147433d-9038-4cad-bc26-f525ec67ddc6 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:27.930109 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147433d-9038-4cad-bc26-f525ec67ddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:27.930486 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147433d-9038-4cad-bc26-f525ec67ddc6 None admin] PATH_INFO: `/v3/groups/a75cf136ec634d87b021d4b61bc3393f` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:27.931926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147433d-9038-4cad-bc26-f525ec67ddc6 None admin] RBAC: Authorizing `identity:get_group(group_id=a75cf136ec634d87b021d4b61bc3393f)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:27.934126 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147433d-9038-4cad-bc26-f525ec67ddc6 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:27.936012 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 222/445] 10.222.0.121 () {56 vars in 1185 bytes} [Fri Aug 26 00:50:27 2022] GET /identity/v3/groups/a75cf136ec634d87b021d4b61bc3393f => generated 227 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:27.937338 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147433d-9038-4cad-bc26-f525ec67ddc6 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:27.957605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19e872-19fc-458e-93a4-806dcdc31a7b None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:27.997362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:28.012660 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cefafb-cdff-4dbd-ba5c-b8eb285ff8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:28.013350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cefafb-cdff-4dbd-ba5c-b8eb285ff8b6 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:28.013635 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cefafb-cdff-4dbd-ba5c-b8eb285ff8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:28.013912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cefafb-cdff-4dbd-ba5c-b8eb285ff8b6 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:28.014622 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cefafb-cdff-4dbd-ba5c-b8eb285ff8b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:28.014973 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cefafb-cdff-4dbd-ba5c-b8eb285ff8b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:28.016445 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cefafb-cdff-4dbd-ba5c-b8eb285ff8b6 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:28.026369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 224/446] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:50:27 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:28.027263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cefafb-cdff-4dbd-ba5c-b8eb285ff8b6 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:28.094925 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147433d-9038-4cad-bc26-f525ec67ddc6 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:28.140788 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee994e-78a9-4640-a422-ada4ad04cc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:28.141420 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee994e-78a9-4640-a422-ada4ad04cc41 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:28.141699 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee994e-78a9-4640-a422-ada4ad04cc41 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:28.141979 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee994e-78a9-4640-a422-ada4ad04cc41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:28.156771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cefafb-cdff-4dbd-ba5c-b8eb285ff8b6 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:28.188096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:28.214055 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33bb01-31d0-461f-956a-135e5e92377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:28.215796 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33bb01-31d0-461f-956a-135e5e92377b None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:28.215796 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33bb01-31d0-461f-956a-135e5e92377b None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:28.216097 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33bb01-31d0-461f-956a-135e5e92377b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:28.217391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33bb01-31d0-461f-956a-135e5e92377b None admin] RBAC: Adding query filter params (group.id=a75cf136ec634d87b021d4b61bc3393f, role.id=034b8b83b5934694bebbf0e19a81dc15, scope.project.id=feb83e414d37430ab448d27e7af47df5) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:28.217781 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33bb01-31d0-461f-956a-135e5e92377b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:28.220202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33bb01-31d0-461f-956a-135e5e92377b None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:28.229156 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 225/447] 10.222.0.121 () {56 vars in 1381 bytes} [Fri Aug 26 00:50:28 2022] GET /identity/v3/role_assignments?group.id=a75cf136ec634d87b021d4b61bc3393f&scope.project.id=feb83e414d37430ab448d27e7af47df5&role.id=034b8b83b5934694bebbf0e19a81dc15 => generated 613 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:28.230781 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33bb01-31d0-461f-956a-135e5e92377b None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:28.266619 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee994e-78a9-4640-a422-ada4ad04cc41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:28.268615 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee994e-78a9-4640-a422-ada4ad04cc41 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:28.320904 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:28.388305 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33bb01-31d0-461f-956a-135e5e92377b None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:28.442394 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaa599-aa9c-4d4b-ba92-5a7968f37442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:28.443421 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaa599-aa9c-4d4b-ba92-5a7968f37442 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:28.443784 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaa599-aa9c-4d4b-ba92-5a7968f37442 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:28.444502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaa599-aa9c-4d4b-ba92-5a7968f37442 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:28.483655 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 223/448] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:27 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:28.492995 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee994e-78a9-4640-a422-ada4ad04cc41 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:28.558607 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feaa599-aa9c-4d4b-ba92-5a7968f37442 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:28.560153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feaa599-aa9c-4d4b-ba92-5a7968f37442 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:28.581728 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:28.630651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee994e-78a9-4640-a422-ada4ad04cc41 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:28.637086 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:28.679411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fe77d-c5ee-4bdc-b737-901ed738ead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:28.680425 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fe77d-c5ee-4bdc-b737-901ed738ead8 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:28.680892 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fe77d-c5ee-4bdc-b737-901ed738ead8 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:28.681360 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fe77d-c5ee-4bdc-b737-901ed738ead8 None admin] PATH_INFO: `/v3/projects/e4454f1e3bf94358ad484413a3205af0` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:28.683859 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fe77d-c5ee-4bdc-b737-901ed738ead8 None admin] RBAC: Authorizing `identity:get_project(project_id=e4454f1e3bf94358ad484413a3205af0)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:28.686563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107fe77d-c5ee-4bdc-b737-901ed738ead8 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:28.690003 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 224/449] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:28 2022] GET /identity/v3/projects/e4454f1e3bf94358ad484413a3205af0 => generated 345 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:28.696363 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fe77d-c5ee-4bdc-b737-901ed738ead8 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:28.706354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 226/450] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:28 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:28.712911 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaa599-aa9c-4d4b-ba92-5a7968f37442 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:28.837247 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaa599-aa9c-4d4b-ba92-5a7968f37442 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:28.856693 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fe77d-c5ee-4bdc-b737-901ed738ead8 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:28.877940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcf756-960a-4214-8752-40b049d9543c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:28.878584 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf756-960a-4214-8752-40b049d9543c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:28.878899 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf756-960a-4214-8752-40b049d9543c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:28.879176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf756-960a-4214-8752-40b049d9543c None admin] PATH_INFO: `/v3/projects/feb83e414d37430ab448d27e7af47df5` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:28.880350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcf756-960a-4214-8752-40b049d9543c None admin] RBAC: Authorizing `identity:get_project(project_id=feb83e414d37430ab448d27e7af47df5)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:28.881856 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcf756-960a-4214-8752-40b049d9543c None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:28.883597 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 227/451] 10.222.0.121 () {56 vars in 1191 bytes} [Fri Aug 26 00:50:28 2022] GET /identity/v3/projects/feb83e414d37430ab448d27e7af47df5 => generated 303 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:28.886663 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:28.890681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcf756-960a-4214-8752-40b049d9543c None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:28.896005 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41030793-a15d-42b4-b4bc-300d5bbc0c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:28.897539 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41030793-a15d-42b4-b4bc-300d5bbc0c37 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:28.897539 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41030793-a15d-42b4-b4bc-300d5bbc0c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:28.897539 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41030793-a15d-42b4-b4bc-300d5bbc0c37 None admin] PATH_INFO: `/v3/groups/b50dd6e5862e49c5973694870b25abf8` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:28.903060 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41030793-a15d-42b4-b4bc-300d5bbc0c37 None admin] RBAC: Authorizing `identity:get_group(group_id=b50dd6e5862e49c5973694870b25abf8)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:28.903060 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41030793-a15d-42b4-b4bc-300d5bbc0c37 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:28.903060 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 225/452] 10.222.0.121 () {56 vars in 1185 bytes} [Fri Aug 26 00:50:28 2022] GET /identity/v3/groups/b50dd6e5862e49c5973694870b25abf8 => generated 230 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:28.907794 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41030793-a15d-42b4-b4bc-300d5bbc0c37 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:28.922178 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:29.027462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcf756-960a-4214-8752-40b049d9543c None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:29.028393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41030793-a15d-42b4-b4bc-300d5bbc0c37 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:29.065597 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e1886-04b0-49da-948d-5acba9fb94a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:29.066232 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e1886-04b0-49da-948d-5acba9fb94a5 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:29.066508 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e1886-04b0-49da-948d-5acba9fb94a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:29.066782 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e1886-04b0-49da-948d-5acba9fb94a5 None admin] PATH_INFO: `/v3/groups/a75cf136ec634d87b021d4b61bc3393f` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:29.068008 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e1886-04b0-49da-948d-5acba9fb94a5 None admin] RBAC: Authorizing `identity:get_group(group_id=a75cf136ec634d87b021d4b61bc3393f)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:29.069734 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e1886-04b0-49da-948d-5acba9fb94a5 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:29.071607 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 228/453] 10.222.0.121 () {56 vars in 1185 bytes} [Fri Aug 26 00:50:28 2022] GET /identity/v3/groups/a75cf136ec634d87b021d4b61bc3393f => generated 227 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:29.078965 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6c41a-3759-44ce-b155-ff360af55768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:29.079599 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6c41a-3759-44ce-b155-ff360af55768 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:29.079707 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e1886-04b0-49da-948d-5acba9fb94a5 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:29.079884 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6c41a-3759-44ce-b155-ff360af55768 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:29.080163 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6c41a-3759-44ce-b155-ff360af55768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:29.080907 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6c41a-3759-44ce-b155-ff360af55768 None admin] RBAC: Adding query filter params (group.id=b50dd6e5862e49c5973694870b25abf8, role.id=e73a8fc0684c4f6083a71ea9a85c7298, scope.project.id=e4454f1e3bf94358ad484413a3205af0) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:29.081219 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6c41a-3759-44ce-b155-ff360af55768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:29.082715 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6c41a-3759-44ce-b155-ff360af55768 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:29.089450 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 226/454] 10.222.0.121 () {56 vars in 1381 bytes} [Fri Aug 26 00:50:28 2022] GET /identity/v3/role_assignments?group.id=b50dd6e5862e49c5973694870b25abf8&scope.project.id=e4454f1e3bf94358ad484413a3205af0&role.id=e73a8fc0684c4f6083a71ea9a85c7298 => generated 613 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:29.197992 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:29.218534 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e1886-04b0-49da-948d-5acba9fb94a5 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:29.265504 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4f28c-d392-4f3b-ae49-6a37f9c0d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:29.266331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4f28c-d392-4f3b-ae49-6a37f9c0d1df None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:29.266611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4f28c-d392-4f3b-ae49-6a37f9c0d1df None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:29.266920 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4f28c-d392-4f3b-ae49-6a37f9c0d1df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:29.267776 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4f28c-d392-4f3b-ae49-6a37f9c0d1df None admin] RBAC: Adding query filter params (group.id=a75cf136ec634d87b021d4b61bc3393f, role.id=8acc6a2016c149a0b80cf3c56b5ae91a, scope.project.id=feb83e414d37430ab448d27e7af47df5) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:29.268203 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4f28c-d392-4f3b-ae49-6a37f9c0d1df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:29.269734 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4f28c-d392-4f3b-ae49-6a37f9c0d1df None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:29.277916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 229/455] 10.222.0.121 () {56 vars in 1381 bytes} [Fri Aug 26 00:50:29 2022] GET /identity/v3/role_assignments?group.id=a75cf136ec634d87b021d4b61bc3393f&scope.project.id=feb83e414d37430ab448d27e7af47df5&role.id=8acc6a2016c149a0b80cf3c56b5ae91a => generated 613 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:32.740502 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb03ba-2dce-45e4-a02c-05cd2aa6ae0c None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:32.740502 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb03ba-2dce-45e4-a02c-05cd2aa6ae0c None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:32.740502 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb03ba-2dce-45e4-a02c-05cd2aa6ae0c None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:32.741574 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 227/456] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:32.749416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058cc29-0744-40d8-aa29-18cef1348e1d None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:32.749936 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058cc29-0744-40d8-aa29-18cef1348e1d None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:32.750376 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058cc29-0744-40d8-aa29-18cef1348e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:32.771199 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc142721-1cba-43e2-aac6-d43b7df26171 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:32.771826 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc142721-1cba-43e2-aac6-d43b7df26171 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:32.772372 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc142721-1cba-43e2-aac6-d43b7df26171 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:32.773996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 228/457] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:32.781917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-9058cc29-0744-40d8-aa29-18cef1348e1d None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:32.782313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc0689-2cdf-413d-9d99-a07a7fca86b6 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:32.782535 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc0689-2cdf-413d-9d99-a07a7fca86b6 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:32.782811 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc0689-2cdf-413d-9d99-a07a7fca86b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:32.783536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-9058cc29-0744-40d8-aa29-18cef1348e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:32.810724 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-c6dc0689-2cdf-413d-9d99-a07a7fca86b6 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:32.812834 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-c6dc0689-2cdf-413d-9d99-a07a7fca86b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:32.895784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:32.902569 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 230/458] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:32.914973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 229/459] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:33.102977 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616676a-5009-42cb-acb1-594cadd2749c None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:33.103829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616676a-5009-42cb-acb1-594cadd2749c None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:33.104973 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616676a-5009-42cb-acb1-594cadd2749c None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:33.107445 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 231/460] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:33 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:33.117031 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211a546-4d86-44d4-83e9-e4f71ba5a203 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:33.117968 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211a546-4d86-44d4-83e9-e4f71ba5a203 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:33.118742 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211a546-4d86-44d4-83e9-e4f71ba5a203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:33.147110 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-7211a546-4d86-44d4-83e9-e4f71ba5a203 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:33.149308 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-7211a546-4d86-44d4-83e9-e4f71ba5a203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:33.224057 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f69601-a26e-4cad-8527-0884bda04cb5 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:33.224386 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f69601-a26e-4cad-8527-0884bda04cb5 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:33.224617 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f69601-a26e-4cad-8527-0884bda04cb5 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:33.226204 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 232/461] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:33.231925 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4a487-2ecf-48e5-b50e-cb8cc632601e None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:33.232924 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4a487-2ecf-48e5-b50e-cb8cc632601e None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:33.233216 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4a487-2ecf-48e5-b50e-cb8cc632601e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:33.251335 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 230/462] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:33.254266 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211a546-4d86-44d4-83e9-e4f71ba5a203 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:33.254444 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-ebf4a487-2ecf-48e5-b50e-cb8cc632601e None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:33.255168 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-ebf4a487-2ecf-48e5-b50e-cb8cc632601e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:33.362662 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 233/463] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:33.364699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4a487-2ecf-48e5-b50e-cb8cc632601e None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:33.397619 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:33.411996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211a546-4d86-44d4-83e9-e4f71ba5a203 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:33.439197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:33.456733 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27cd13-849f-4c90-bbea-fdbb8106c163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:33.458290 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27cd13-849f-4c90-bbea-fdbb8106c163 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:33.458932 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27cd13-849f-4c90-bbea-fdbb8106c163 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:33.459696 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27cd13-849f-4c90-bbea-fdbb8106c163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:33.473817 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27cd13-849f-4c90-bbea-fdbb8106c163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:33.475946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27cd13-849f-4c90-bbea-fdbb8106c163 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-6a27cd13-849f-4c90-bbea-fdbb8106c163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:33.498189 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:33.499544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:33.500376 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:33.500376 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:33.500376 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:33.500542 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 231/464] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:33.509641 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27cd13-849f-4c90-bbea-fdbb8106c163 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:33.552845 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4a487-2ecf-48e5-b50e-cb8cc632601e None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:33.596114 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2007a8-770e-434d-8ace-ab4a801c6d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:33.597236 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2007a8-770e-434d-8ace-ab4a801c6d2d None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:33.597702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2007a8-770e-434d-8ace-ab4a801c6d2d None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:33.598181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2007a8-770e-434d-8ace-ab4a801c6d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:33.611129 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2007a8-770e-434d-8ace-ab4a801c6d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:33.613040 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2007a8-770e-434d-8ace-ab4a801c6d2d None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-9b2007a8-770e-434d-8ace-ab4a801c6d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:33.632498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:33.634240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:33.635900 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:33.635900 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:33.635900 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:33.635900 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 234/465] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:33.639582 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2007a8-770e-434d-8ace-ab4a801c6d2d None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:33.665793 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27cd13-849f-4c90-bbea-fdbb8106c163 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:33.705862 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b90f0-d94f-49a6-a28d-ac5023f3dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:33.707171 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b90f0-d94f-49a6-a28d-ac5023f3dc26 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:33.707458 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b90f0-d94f-49a6-a28d-ac5023f3dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:33.707734 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b90f0-d94f-49a6-a28d-ac5023f3dc26 None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:33.708403 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b90f0-d94f-49a6-a28d-ac5023f3dc26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:33.708705 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b90f0-d94f-49a6-a28d-ac5023f3dc26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:33.710653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b90f0-d94f-49a6-a28d-ac5023f3dc26 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:33.730478 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 232/466] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:33.731393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b90f0-d94f-49a6-a28d-ac5023f3dc26 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:33.742075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:33.774457 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:33.787783 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2007a8-770e-434d-8ace-ab4a801c6d2d None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:33.833024 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071c461-719a-464a-a897-a08885f4c7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:33.833689 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071c461-719a-464a-a897-a08885f4c7e1 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:33.833970 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071c461-719a-464a-a897-a08885f4c7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:33.834240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071c461-719a-464a-a897-a08885f4c7e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:33.846568 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071c461-719a-464a-a897-a08885f4c7e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:33.848749 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071c461-719a-464a-a897-a08885f4c7e1 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-2071c461-719a-464a-a897-a08885f4c7e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:33.865096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:33.866199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:33.867643 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:33.867643 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:33.867643 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:33.867643 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 235/467] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:33.869169 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071c461-719a-464a-a897-a08885f4c7e1 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:33.872541 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b90f0-d94f-49a6-a28d-ac5023f3dc26 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:33.927048 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2100fd-4a42-40b7-962c-3e0a293d39c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:33.927684 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2100fd-4a42-40b7-962c-3e0a293d39c0 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:33.927975 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2100fd-4a42-40b7-962c-3e0a293d39c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:33.928248 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2100fd-4a42-40b7-962c-3e0a293d39c0 None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:33.928907 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2100fd-4a42-40b7-962c-3e0a293d39c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:33.929209 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2100fd-4a42-40b7-962c-3e0a293d39c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:33.930627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2100fd-4a42-40b7-962c-3e0a293d39c0 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:33.945282 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 233/468] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:33.946495 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2100fd-4a42-40b7-962c-3e0a293d39c0 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:34.005537 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071c461-719a-464a-a897-a08885f4c7e1 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:34.021517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:34.045491 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb860e-1415-4bca-8f76-9249870743a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:34.046384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb860e-1415-4bca-8f76-9249870743a1 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:34.046798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb860e-1415-4bca-8f76-9249870743a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:34.047566 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb860e-1415-4bca-8f76-9249870743a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:34.062649 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb860e-1415-4bca-8f76-9249870743a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:34.065037 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:34.065580 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb860e-1415-4bca-8f76-9249870743a1 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:34.078776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2100fd-4a42-40b7-962c-3e0a293d39c0 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-13eb860e-1415-4bca-8f76-9249870743a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:34.086012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:34.088573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:34.091958 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:34.091958 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:34.091958 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:34.091958 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 236/469] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:34.091958 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb860e-1415-4bca-8f76-9249870743a1 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:34.130287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a5f41-b9ff-49b8-b1b4-2280995f1be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:34.130919 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a5f41-b9ff-49b8-b1b4-2280995f1be4 None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:34.131389 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a5f41-b9ff-49b8-b1b4-2280995f1be4 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:34.131761 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a5f41-b9ff-49b8-b1b4-2280995f1be4 None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:34.132608 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a5f41-b9ff-49b8-b1b4-2280995f1be4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:34.134259 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a5f41-b9ff-49b8-b1b4-2280995f1be4 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:34.213297 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb860e-1415-4bca-8f76-9249870743a1 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:34.251405 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc362a7-7980-41f5-81f3-04d28fa143f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:34.252013 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc362a7-7980-41f5-81f3-04d28fa143f0 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:34.252289 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc362a7-7980-41f5-81f3-04d28fa143f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:34.252561 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc362a7-7980-41f5-81f3-04d28fa143f0 None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:34.253207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc362a7-7980-41f5-81f3-04d28fa143f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:34.253536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc362a7-7980-41f5-81f3-04d28fa143f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:34.255090 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc362a7-7980-41f5-81f3-04d28fa143f0 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:34.272497 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 237/470] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:34.273349 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc362a7-7980-41f5-81f3-04d28fa143f0 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:34.285150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 234/471] 10.222.0.121 () {60 vars in 1137 bytes} [Fri Aug 26 00:50:33 2022] POST /identity/v3/users => generated 249 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:50:34.286088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a5f41-b9ff-49b8-b1b4-2280995f1be4 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:34.321158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:34.429773 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc362a7-7980-41f5-81f3-04d28fa143f0 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:34.477346 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a99b0e-c22a-47e2-adfb-8bc4b1c49631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:34.477976 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a99b0e-c22a-47e2-adfb-8bc4b1c49631 None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:34.478259 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a99b0e-c22a-47e2-adfb-8bc4b1c49631 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:34.478531 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a99b0e-c22a-47e2-adfb-8bc4b1c49631 None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:34.479293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a99b0e-c22a-47e2-adfb-8bc4b1c49631 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:34.481422 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a99b0e-c22a-47e2-adfb-8bc4b1c49631 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:34.489866 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a5f41-b9ff-49b8-b1b4-2280995f1be4 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:34.545067 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a5134-af14-4e25-aa71-c196f1e9a1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:34.545694 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a5134-af14-4e25-aa71-c196f1e9a1cb None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:34.545974 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a5134-af14-4e25-aa71-c196f1e9a1cb None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:34.546250 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a5134-af14-4e25-aa71-c196f1e9a1cb None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:34.546942 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a5134-af14-4e25-aa71-c196f1e9a1cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:34.547247 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a5134-af14-4e25-aa71-c196f1e9a1cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:34.548663 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a5134-af14-4e25-aa71-c196f1e9a1cb None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:34.572396 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 235/472] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:34.581732 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a5134-af14-4e25-aa71-c196f1e9a1cb None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:34.589424 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:34.616722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 238/473] 10.222.0.121 () {60 vars in 1137 bytes} [Fri Aug 26 00:50:34 2022] POST /identity/v3/users => generated 247 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:50:34.618986 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a99b0e-c22a-47e2-adfb-8bc4b1c49631 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:34.757289 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a5134-af14-4e25-aa71-c196f1e9a1cb None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:34.810743 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:34.811572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46826e-94cc-4507-967d-665023d46289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:34.812088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46826e-94cc-4507-967d-665023d46289 None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:34.812209 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46826e-94cc-4507-967d-665023d46289 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:34.812549 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46826e-94cc-4507-967d-665023d46289 None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:34.813149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46826e-94cc-4507-967d-665023d46289 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:34.814951 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46826e-94cc-4507-967d-665023d46289 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:34.853012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a99b0e-c22a-47e2-adfb-8bc4b1c49631 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:34.926126 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef66f4f-8a09-48f2-bcba-d89fa8afe25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:34.927181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66f4f-8a09-48f2-bcba-d89fa8afe25e None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:34.927655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66f4f-8a09-48f2-bcba-d89fa8afe25e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:34.928136 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66f4f-8a09-48f2-bcba-d89fa8afe25e None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:34.929477 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef66f4f-8a09-48f2-bcba-d89fa8afe25e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:34.932351 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef66f4f-8a09-48f2-bcba-d89fa8afe25e None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:35.008858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 236/474] 10.222.0.121 () {60 vars in 1137 bytes} [Fri Aug 26 00:50:34 2022] POST /identity/v3/users => generated 249 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:50:35.137596 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 239/475] 10.222.0.121 () {60 vars in 1137 bytes} [Fri Aug 26 00:50:34 2022] POST /identity/v3/users => generated 250 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:50:36.772072 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464ca44-cb45-4927-9f74-0db7251a26b0 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:36.772563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464ca44-cb45-4927-9f74-0db7251a26b0 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:36.772563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464ca44-cb45-4927-9f74-0db7251a26b0 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:36.774284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 237/476] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:36.781153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e8797-60fc-4141-9fdc-3d4736e9d372 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:36.781767 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e8797-60fc-4141-9fdc-3d4736e9d372 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:36.781767 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e8797-60fc-4141-9fdc-3d4736e9d372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:36.802599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-c98e8797-60fc-4141-9fdc-3d4736e9d372 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:36.803899 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-c98e8797-60fc-4141-9fdc-3d4736e9d372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:36.890630 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 240/477] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:37.234479 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464ca44-cb45-4927-9f74-0db7251a26b0 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:37.317900 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:37.367922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464ca44-cb45-4927-9f74-0db7251a26b0 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:37.411063 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d69f3c-4324-42de-9972-7de095befdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:37.411711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d69f3c-4324-42de-9972-7de095befdaf None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:37.411989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d69f3c-4324-42de-9972-7de095befdaf None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:37.412258 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d69f3c-4324-42de-9972-7de095befdaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:37.425671 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d69f3c-4324-42de-9972-7de095befdaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-b7d69f3c-4324-42de-9972-7de095befdaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:37.431435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:37.432893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:37.433920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:37.433920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:37.433920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:37.433920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:37.433920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:37.433920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:37.433920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:37.433920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:37.433920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:37.433920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:37.433920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:37.433920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:37.433920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 238/478] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:50:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:37.440583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e8797-60fc-4141-9fdc-3d4736e9d372 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:37.545897 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:37.597061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e8797-60fc-4141-9fdc-3d4736e9d372 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:37.665696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe11d5-1930-4c5b-96d8-eac76b4d9a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:37.667344 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe11d5-1930-4c5b-96d8-eac76b4d9a82 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:37.667834 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe11d5-1930-4c5b-96d8-eac76b4d9a82 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:37.668326 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe11d5-1930-4c5b-96d8-eac76b4d9a82 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:37.669506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe11d5-1930-4c5b-96d8-eac76b4d9a82 None admin] RBAC: Adding query filter params (name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:37.670115 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe11d5-1930-4c5b-96d8-eac76b4d9a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:37.673633 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe11d5-1930-4c5b-96d8-eac76b4d9a82 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:37.691799 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 241/479] 10.222.0.121 () {56 vars in 1108 bytes} [Fri Aug 26 00:50:37 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:37.697379 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d69f3c-4324-42de-9972-7de095befdaf None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:37.714590 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f92811-0e79-4650-9b14-d4d694b05706 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:37.715268 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f92811-0e79-4650-9b14-d4d694b05706 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:37.715743 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f92811-0e79-4650-9b14-d4d694b05706 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:37.722949 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 242/480] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:50:37.725063 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90ea59-f6e7-4601-8f31-b89169054dc9 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:37.725580 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90ea59-f6e7-4601-8f31-b89169054dc9 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:37.726077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90ea59-f6e7-4601-8f31-b89169054dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:37.749965 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-3f90ea59-f6e7-4601-8f31-b89169054dc9 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:37.752210 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-3f90ea59-f6e7-4601-8f31-b89169054dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:37.843819 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d69f3c-4324-42de-9972-7de095befdaf None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:37.848366 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 243/481] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:50:37.850338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ac933-34b1-4778-8fb6-bf2f2f7d5305 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:37.850655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ac933-34b1-4778-8fb6-bf2f2f7d5305 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:37.850943 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ac933-34b1-4778-8fb6-bf2f2f7d5305 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:37.852597 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 244/482] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:37.858959 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9969f2d-82fe-49e8-8f01-bd2325682062 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:37.859365 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9969f2d-82fe-49e8-8f01-bd2325682062 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:37.859676 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9969f2d-82fe-49e8-8f01-bd2325682062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:37.889208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-c9969f2d-82fe-49e8-8f01-bd2325682062 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:37.892079 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-c9969f2d-82fe-49e8-8f01-bd2325682062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:37.908160 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:37.929221 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba369731-5c37-4225-85ba-77d1d73064c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:37.933057 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba369731-5c37-4225-85ba-77d1d73064c3 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:37.933057 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba369731-5c37-4225-85ba-77d1d73064c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:37.933057 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba369731-5c37-4225-85ba-77d1d73064c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:37.954402 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba369731-5c37-4225-85ba-77d1d73064c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:37.957707 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba369731-5c37-4225-85ba-77d1d73064c3 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:37.971170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:37.986324 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 245/483] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-ba369731-5c37-4225-85ba-77d1d73064c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:37.995871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:37.997627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:37.999193 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:37.999193 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:37.999193 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:37.999193 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 239/484] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:38.009498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9969f2d-82fe-49e8-8f01-bd2325682062 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:38.210964 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9969f2d-82fe-49e8-8f01-bd2325682062 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:38.276907 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f85ff6-bd85-4659-9126-063c989915be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:38.277961 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f85ff6-bd85-4659-9126-063c989915be None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:38.278453 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f85ff6-bd85-4659-9126-063c989915be None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:38.278972 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f85ff6-bd85-4659-9126-063c989915be None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:38.280184 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f85ff6-bd85-4659-9126-063c989915be None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:38.280709 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f85ff6-bd85-4659-9126-063c989915be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:38.283407 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f85ff6-bd85-4659-9126-063c989915be None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:38.310892 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 246/485] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:38.317003 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba369731-5c37-4225-85ba-77d1d73064c3 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:38.355015 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f85ff6-bd85-4659-9126-063c989915be None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:38.453617 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:38.481121 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba369731-5c37-4225-85ba-77d1d73064c3 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:38.522850 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f85ff6-bd85-4659-9126-063c989915be None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:38.527636 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6c118-2af4-43be-ac61-d3733767f89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:38.528402 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6c118-2af4-43be-ac61-d3733767f89b None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:38.528913 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6c118-2af4-43be-ac61-d3733767f89b None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:38.529225 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6c118-2af4-43be-ac61-d3733767f89b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:38.540872 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6c118-2af4-43be-ac61-d3733767f89b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:38.543192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6c118-2af4-43be-ac61-d3733767f89b None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-6de6c118-2af4-43be-ac61-d3733767f89b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:50:38.559675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:38.561441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:38.563411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:38.563411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:38.563411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:50:38.563411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:50:38.563411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:50:38.563411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:50:38.563411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:50:38.563411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:50:38.563411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:50:38.563411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:38.563411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 240/486] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:50:38.563411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e96d75-a409-4a52-9330-aa3deee479ea None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:38.563411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e96d75-a409-4a52-9330-aa3deee479ea None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:38.564738 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e96d75-a409-4a52-9330-aa3deee479ea None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:38.564738 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 241/487] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:38.566787 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e96d75-a409-4a52-9330-aa3deee479ea None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:38.579328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84a7f7-2ec6-4316-9b09-7cb9cfd87a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:38.579979 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84a7f7-2ec6-4316-9b09-7cb9cfd87a62 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:38.580262 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84a7f7-2ec6-4316-9b09-7cb9cfd87a62 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:38.580538 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84a7f7-2ec6-4316-9b09-7cb9cfd87a62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:38.592291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84a7f7-2ec6-4316-9b09-7cb9cfd87a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-5d84a7f7-2ec6-4316-9b09-7cb9cfd87a62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:38.598339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:38.600434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:38.602263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:38.602263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:38.602263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:38.602263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:38.602263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:38.602263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:38.602263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:38.602263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:38.602263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:38.602263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:38.602263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:38.602263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:38.602263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 247/488] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:50:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:50:38.604414 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84a7f7-2ec6-4316-9b09-7cb9cfd87a62 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:38.631533 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:38.730354 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e96d75-a409-4a52-9330-aa3deee479ea None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:38.746506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84a7f7-2ec6-4316-9b09-7cb9cfd87a62 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:38.757770 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:38.774073 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0f6b2-528e-4ee5-98a7-c52dd06da36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:38.776669 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0f6b2-528e-4ee5-98a7-c52dd06da36b None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:38.776669 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0f6b2-528e-4ee5-98a7-c52dd06da36b None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:38.776669 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0f6b2-528e-4ee5-98a7-c52dd06da36b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:38.786343 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681f663-3072-4f64-bd23-0f386f6f0610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:38.787692 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681f663-3072-4f64-bd23-0f386f6f0610 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:38.788181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681f663-3072-4f64-bd23-0f386f6f0610 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:38.788681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681f663-3072-4f64-bd23-0f386f6f0610 None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:38.790099 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681f663-3072-4f64-bd23-0f386f6f0610 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:38.790647 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681f663-3072-4f64-bd23-0f386f6f0610 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:38.794049 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681f663-3072-4f64-bd23-0f386f6f0610 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:38.795930 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0f6b2-528e-4ee5-98a7-c52dd06da36b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-4cf0f6b2-528e-4ee5-98a7-c52dd06da36b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:38.801380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:38.802305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:38.803119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:38.803119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:38.803119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:38.803119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:38.803119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:38.803119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:38.803119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:38.803119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:38.803119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:38.803119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:38.803119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:38.803119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:38.803119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 242/489] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:50:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:38.804062 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028acf0-1180-4650-a69d-71964fc51668 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:38.804151 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028acf0-1180-4650-a69d-71964fc51668 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:38.804641 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028acf0-1180-4650-a69d-71964fc51668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:38.823879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-1028acf0-1180-4650-a69d-71964fc51668 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:38.825115 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-1028acf0-1180-4650-a69d-71964fc51668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:38.876166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 248/490] 10.222.0.121 () {56 vars in 1142 bytes} [Fri Aug 26 00:50:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:38.876166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681f663-3072-4f64-bd23-0f386f6f0610 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:38.911920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 243/491] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:38.912825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028acf0-1180-4650-a69d-71964fc51668 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:38.958665 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:39.031351 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681f663-3072-4f64-bd23-0f386f6f0610 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:39.077770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028acf0-1180-4650-a69d-71964fc51668 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:39.098515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb33089-7015-434e-b4dd-87f755e7bc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:39.099850 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb33089-7015-434e-b4dd-87f755e7bc93 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:39.100833 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb33089-7015-434e-b4dd-87f755e7bc93 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:39.101415 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb33089-7015-434e-b4dd-87f755e7bc93 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:39.102605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb33089-7015-434e-b4dd-87f755e7bc93 None admin] RBAC: Adding query filter params (name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:39.103175 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb33089-7015-434e-b4dd-87f755e7bc93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:39.106714 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb33089-7015-434e-b4dd-87f755e7bc93 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:39.123695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9198-5dab-4bd5-bd0d-b8f52b4147ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:39.128777 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 249/492] 10.222.0.121 () {56 vars in 1108 bytes} [Fri Aug 26 00:50:38 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:39.128777 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb33089-7015-434e-b4dd-87f755e7bc93 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:39.129084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9198-5dab-4bd5-bd0d-b8f52b4147ec None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:39.129084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9198-5dab-4bd5-bd0d-b8f52b4147ec None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:39.129763 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9198-5dab-4bd5-bd0d-b8f52b4147ec None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:39.131040 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b9198-5dab-4bd5-bd0d-b8f52b4147ec None admin] RBAC: Adding query filter params (name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:39.131588 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b9198-5dab-4bd5-bd0d-b8f52b4147ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:39.134199 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b9198-5dab-4bd5-bd0d-b8f52b4147ec None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:39.151154 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 244/493] 10.222.0.121 () {56 vars in 1108 bytes} [Fri Aug 26 00:50:38 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:39.152643 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9198-5dab-4bd5-bd0d-b8f52b4147ec None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:39.187336 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:39.290107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:39.307972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9198-5dab-4bd5-bd0d-b8f52b4147ec None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:39.317479 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb33089-7015-434e-b4dd-87f755e7bc93 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:39.348033 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b45782-826b-4299-a9fc-199029af51c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:39.348682 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b45782-826b-4299-a9fc-199029af51c7 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:39.348965 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b45782-826b-4299-a9fc-199029af51c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:39.349241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b45782-826b-4299-a9fc-199029af51c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:39.362944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b45782-826b-4299-a9fc-199029af51c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:39.365537 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b45782-826b-4299-a9fc-199029af51c7 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:39.372145 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ebea2-046d-4e61-9552-2ee901f63d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:39.372773 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ebea2-046d-4e61-9552-2ee901f63d9a None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:39.373049 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ebea2-046d-4e61-9552-2ee901f63d9a None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:39.373320 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ebea2-046d-4e61-9552-2ee901f63d9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-e8b45782-826b-4299-a9fc-199029af51c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:39.393138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:39.394136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:39.394999 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:39.394999 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:39.394999 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:39.395182 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 245/494] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:39.396663 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b45782-826b-4299-a9fc-199029af51c7 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:39.461208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ebea2-046d-4e61-9552-2ee901f63d9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:39.462714 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ebea2-046d-4e61-9552-2ee901f63d9a None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:39.497884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:39.560029 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b45782-826b-4299-a9fc-199029af51c7 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:39.598403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 250/495] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:39 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:39.599571 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ebea2-046d-4e61-9552-2ee901f63d9a None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:39.615231 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b19e0-5ee0-4b60-8040-1f74de124fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:39.615876 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b19e0-5ee0-4b60-8040-1f74de124fe3 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:39.616154 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b19e0-5ee0-4b60-8040-1f74de124fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:39.616428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b19e0-5ee0-4b60-8040-1f74de124fe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:39.631470 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:39.635416 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b19e0-5ee0-4b60-8040-1f74de124fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:39.638066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b19e0-5ee0-4b60-8040-1f74de124fe3 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-5a4b19e0-5ee0-4b60-8040-1f74de124fe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:39.664499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:39.666038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:39.668308 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:39.668308 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:39.668308 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:39.668308 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 246/496] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:39.668308 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b19e0-5ee0-4b60-8040-1f74de124fe3 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:39.725219 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ebea2-046d-4e61-9552-2ee901f63d9a None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:39.762282 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:39.768558 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe063a9-1c7a-41f2-95ae-c3a325d74a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:39.769201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe063a9-1c7a-41f2-95ae-c3a325d74a26 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:39.769473 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe063a9-1c7a-41f2-95ae-c3a325d74a26 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:39.769740 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe063a9-1c7a-41f2-95ae-c3a325d74a26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:39.783710 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe063a9-1c7a-41f2-95ae-c3a325d74a26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-cfe063a9-1c7a-41f2-95ae-c3a325d74a26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:39.788751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:39.790798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:39.792866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:39.792866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:39.792866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:39.792866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:39.792866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:39.792866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:39.792866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:39.792866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:39.792866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:39.792866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:39.792866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:39.792866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:39.792866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 251/497] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:50:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:39.792866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe063a9-1c7a-41f2-95ae-c3a325d74a26 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:39.810438 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b19e0-5ee0-4b60-8040-1f74de124fe3 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:39.850277 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543184f-01d6-4023-ac3e-e7a8c3f435d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:39.850927 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543184f-01d6-4023-ac3e-e7a8c3f435d1 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:39.851210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543184f-01d6-4023-ac3e-e7a8c3f435d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:39.851484 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543184f-01d6-4023-ac3e-e7a8c3f435d1 None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:39.852145 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543184f-01d6-4023-ac3e-e7a8c3f435d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:39.852451 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543184f-01d6-4023-ac3e-e7a8c3f435d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:39.853926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543184f-01d6-4023-ac3e-e7a8c3f435d1 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:39.868650 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 247/498] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:39.870639 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543184f-01d6-4023-ac3e-e7a8c3f435d1 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:39.944490 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:39.951126 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe063a9-1c7a-41f2-95ae-c3a325d74a26 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:39.998756 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aed8f4-93a2-4857-9c40-b4622b4eda81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:39.999432 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aed8f4-93a2-4857-9c40-b4622b4eda81 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:39.999791 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aed8f4-93a2-4857-9c40-b4622b4eda81 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:40.000062 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aed8f4-93a2-4857-9c40-b4622b4eda81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:40.012494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aed8f4-93a2-4857-9c40-b4622b4eda81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:40.013315 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543184f-01d6-4023-ac3e-e7a8c3f435d1 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:40.014004 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aed8f4-93a2-4857-9c40-b4622b4eda81 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-99aed8f4-93a2-4857-9c40-b4622b4eda81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:40.032443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:40.034299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:40.036093 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:40.036093 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:40.036093 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:40.036093 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 252/499] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:40.036093 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aed8f4-93a2-4857-9c40-b4622b4eda81 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:40.065873 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e5029-f5ea-427b-a21f-c9905feb6b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:40.066398 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e5029-f5ea-427b-a21f-c9905feb6b8f None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:40.066676 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e5029-f5ea-427b-a21f-c9905feb6b8f None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:40.066987 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e5029-f5ea-427b-a21f-c9905feb6b8f None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:40.067654 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e5029-f5ea-427b-a21f-c9905feb6b8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:40.068033 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e5029-f5ea-427b-a21f-c9905feb6b8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:40.069786 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e5029-f5ea-427b-a21f-c9905feb6b8f None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:40.083385 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 248/500] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:40.084262 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e5029-f5ea-427b-a21f-c9905feb6b8f None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:40.092619 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:40.172550 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aed8f4-93a2-4857-9c40-b4622b4eda81 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:40.220218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27268f-4ac9-417a-88f0-353b9300c923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:40.221286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27268f-4ac9-417a-88f0-353b9300c923 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:40.221756 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27268f-4ac9-417a-88f0-353b9300c923 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:40.222198 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27268f-4ac9-417a-88f0-353b9300c923 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:40.223351 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27268f-4ac9-417a-88f0-353b9300c923 None admin] RBAC: Adding query filter params (name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:40.223865 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27268f-4ac9-417a-88f0-353b9300c923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:40.226581 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27268f-4ac9-417a-88f0-353b9300c923 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:40.241237 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 253/501] 10.222.0.121 () {56 vars in 1108 bytes} [Fri Aug 26 00:50:40 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:40.242679 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27268f-4ac9-417a-88f0-353b9300c923 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:40.245630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e5029-f5ea-427b-a21f-c9905feb6b8f None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:40.266540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:40.290543 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f9352-37bf-44ab-b8d4-0a4c4e93508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:40.296444 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f9352-37bf-44ab-b8d4-0a4c4e93508c None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:40.296444 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f9352-37bf-44ab-b8d4-0a4c4e93508c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:40.296444 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f9352-37bf-44ab-b8d4-0a4c4e93508c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:40.301347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f9352-37bf-44ab-b8d4-0a4c4e93508c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:40.302872 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f9352-37bf-44ab-b8d4-0a4c4e93508c None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-f59f9352-37bf-44ab-b8d4-0a4c4e93508c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:50:40.315798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:40.317604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:40.319598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:40.319598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:40.319598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:50:40.319598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:50:40.319598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:50:40.319598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:50:40.319598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:50:40.319598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:50:40.319598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:50:40.319598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:40.319598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 249/502] 10.222.0.121 () {56 vars in 1098 bytes} [Fri Aug 26 00:50:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:40.319598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f9352-37bf-44ab-b8d4-0a4c4e93508c None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:40.377109 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27268f-4ac9-417a-88f0-353b9300c923 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:40.379780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:40.420931 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3d67e-7bf9-49da-966b-5c367e9b7a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:40.421691 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3d67e-7bf9-49da-966b-5c367e9b7a21 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:40.421973 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3d67e-7bf9-49da-966b-5c367e9b7a21 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:40.422247 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3d67e-7bf9-49da-966b-5c367e9b7a21 None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:40.422932 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3d67e-7bf9-49da-966b-5c367e9b7a21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:40.423239 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3d67e-7bf9-49da-966b-5c367e9b7a21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:40.424655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3d67e-7bf9-49da-966b-5c367e9b7a21 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:40.434978 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f9352-37bf-44ab-b8d4-0a4c4e93508c None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:40.438248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 254/503] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:40.439218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3d67e-7bf9-49da-966b-5c367e9b7a21 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:40.476163 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbb9eb-3acb-4d45-8704-25045e74d15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:40.476805 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbb9eb-3acb-4d45-8704-25045e74d15f None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:40.477081 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbb9eb-3acb-4d45-8704-25045e74d15f None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:40.477353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbb9eb-3acb-4d45-8704-25045e74d15f None admin] PATH_INFO: `/v3/users/glance` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:40.486206 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbb9eb-3acb-4d45-8704-25045e74d15f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:40.487758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbb9eb-3acb-4d45-8704-25045e74d15f None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-22dbb9eb-3acb-4d45-8704-25045e74d15f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:50:40.500287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:40.502103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:40.504157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:40.504157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:40.504157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:50:40.504157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:50:40.504157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:50:40.504157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:50:40.504157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:50:40.504157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:50:40.504157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:50:40.504157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:40.504157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 250/504] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:40.504157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbb9eb-3acb-4d45-8704-25045e74d15f None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:40.548618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:40.569390 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3d67e-7bf9-49da-966b-5c367e9b7a21 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:40.609836 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f9dce-ebcc-4b3d-8540-4035e816b722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:40.610487 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f9dce-ebcc-4b3d-8540-4035e816b722 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:40.610768 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f9dce-ebcc-4b3d-8540-4035e816b722 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:40.611078 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f9dce-ebcc-4b3d-8540-4035e816b722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:40.622745 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f9dce-ebcc-4b3d-8540-4035e816b722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:40.624319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f9dce-ebcc-4b3d-8540-4035e816b722 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-613f9dce-ebcc-4b3d-8540-4035e816b722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:40.640434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:40.642075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:40.643516 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:40.643516 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:40.643516 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:40.643516 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 255/505] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:40.643516 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f9dce-ebcc-4b3d-8540-4035e816b722 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:40.645086 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbb9eb-3acb-4d45-8704-25045e74d15f None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:40.680906 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:40.690303 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6a6b4-aa8d-4423-9c95-6c3943e54b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:40.691443 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6a6b4-aa8d-4423-9c95-6c3943e54b75 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:40.692024 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6a6b4-aa8d-4423-9c95-6c3943e54b75 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:40.692575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6a6b4-aa8d-4423-9c95-6c3943e54b75 None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:40.694383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6a6b4-aa8d-4423-9c95-6c3943e54b75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:40.694981 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6a6b4-aa8d-4423-9c95-6c3943e54b75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:40.697824 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6a6b4-aa8d-4423-9c95-6c3943e54b75 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:40.740168 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 251/506] 10.222.0.121 () {56 vars in 1138 bytes} [Fri Aug 26 00:50:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:40.741295 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6a6b4-aa8d-4423-9c95-6c3943e54b75 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:40.831871 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f9dce-ebcc-4b3d-8540-4035e816b722 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:40.855378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:40.865876 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6a6b4-aa8d-4423-9c95-6c3943e54b75 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:40.876536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518d750-1901-4228-8fc5-a93d0b43d373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:40.877391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518d750-1901-4228-8fc5-a93d0b43d373 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:40.877699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518d750-1901-4228-8fc5-a93d0b43d373 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:40.877938 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518d750-1901-4228-8fc5-a93d0b43d373 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:40.887340 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518d750-1901-4228-8fc5-a93d0b43d373 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:40.888840 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518d750-1901-4228-8fc5-a93d0b43d373 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:40.903317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-3518d750-1901-4228-8fc5-a93d0b43d373 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:40.903317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:40.903317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:40.903317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:40.903317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:40.903317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:40.903317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:40.903317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:40.903317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:40.903317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:40.903317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:40.903317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:40.903317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:50:40.903317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:50:40.903317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:40.905163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:40.907223 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:50:40.907223 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:50:40.907223 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:50:40.907223 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:50:40.907223 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:50:40.907223 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:50:40.907223 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:40.907223 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:40.907223 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 256/507] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:40.907223 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518d750-1901-4228-8fc5-a93d0b43d373 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:40.917469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b21cad-3c45-4785-b7b1-4df6215b32f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:40.918496 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b21cad-3c45-4785-b7b1-4df6215b32f9 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:40.919016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b21cad-3c45-4785-b7b1-4df6215b32f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:40.919494 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b21cad-3c45-4785-b7b1-4df6215b32f9 None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:40.920845 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b21cad-3c45-4785-b7b1-4df6215b32f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:40.921409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b21cad-3c45-4785-b7b1-4df6215b32f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:40.924310 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b21cad-3c45-4785-b7b1-4df6215b32f9 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:40.965480 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 252/508] 10.222.0.121 () {56 vars in 1142 bytes} [Fri Aug 26 00:50:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:40.965480 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b21cad-3c45-4785-b7b1-4df6215b32f9 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:40.999177 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:41.032819 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518d750-1901-4228-8fc5-a93d0b43d373 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:41.086544 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87b6e1-b8ae-4411-8079-2449f6a04524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:41.087489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87b6e1-b8ae-4411-8079-2449f6a04524 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:41.087946 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87b6e1-b8ae-4411-8079-2449f6a04524 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:41.088448 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87b6e1-b8ae-4411-8079-2449f6a04524 None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:41.089577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87b6e1-b8ae-4411-8079-2449f6a04524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:41.090082 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87b6e1-b8ae-4411-8079-2449f6a04524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:41.092634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87b6e1-b8ae-4411-8079-2449f6a04524 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:41.096075 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b21cad-3c45-4785-b7b1-4df6215b32f9 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:41.112017 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 257/509] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:41.113456 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87b6e1-b8ae-4411-8079-2449f6a04524 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:41.140422 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a66b1-9069-467b-8141-86e7dbab48c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:41.141078 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a66b1-9069-467b-8141-86e7dbab48c0 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:41.141331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a66b1-9069-467b-8141-86e7dbab48c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:41.141606 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a66b1-9069-467b-8141-86e7dbab48c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:41.166279 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:41.226692 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a66b1-9069-467b-8141-86e7dbab48c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:41.228233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a66b1-9069-467b-8141-86e7dbab48c0 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:41.243520 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87b6e1-b8ae-4411-8079-2449f6a04524 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:41.285139 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36eeeb2-33d0-4952-b1b3-ff0c261d835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:41.285879 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36eeeb2-33d0-4952-b1b3-ff0c261d835f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:41.286219 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36eeeb2-33d0-4952-b1b3-ff0c261d835f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:41.286553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36eeeb2-33d0-4952-b1b3-ff0c261d835f None admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:41.287355 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36eeeb2-33d0-4952-b1b3-ff0c261d835f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:41.287714 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36eeeb2-33d0-4952-b1b3-ff0c261d835f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:41.289166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36eeeb2-33d0-4952-b1b3-ff0c261d835f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:41.294112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:41.314113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 258/510] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:50:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:41.315267 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36eeeb2-33d0-4952-b1b3-ff0c261d835f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:41.377073 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 253/511] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:40 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:41.377864 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a66b1-9069-467b-8141-86e7dbab48c0 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:41.439034 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:41.445166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36eeeb2-33d0-4952-b1b3-ff0c261d835f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:41.486956 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd7a89-4a86-484b-bd87-66660da19748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:41.487580 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd7a89-4a86-484b-bd87-66660da19748 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:41.487860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd7a89-4a86-484b-bd87-66660da19748 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:41.488136 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd7a89-4a86-484b-bd87-66660da19748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:41.496081 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a66b1-9069-467b-8141-86e7dbab48c0 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:41.544107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076b0d3-1e43-4573-b739-6f3c3497a37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:41.544741 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076b0d3-1e43-4573-b739-6f3c3497a37b None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:41.545021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076b0d3-1e43-4573-b739-6f3c3497a37b None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:41.545294 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076b0d3-1e43-4573-b739-6f3c3497a37b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:41.553828 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076b0d3-1e43-4573-b739-6f3c3497a37b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:41.555367 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076b0d3-1e43-4573-b739-6f3c3497a37b None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:41.558518 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:41.566220 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd7a89-4a86-484b-bd87-66660da19748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:41.567750 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd7a89-4a86-484b-bd87-66660da19748 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-1076b0d3-1e43-4573-b739-6f3c3497a37b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:50:41.568711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:41.569737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:41.570631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:41.570631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:41.570631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:50:41.570631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:50:41.570631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:50:41.570631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:50:41.570631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:50:41.570631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:50:41.570631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:50:41.570631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:41.570631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 254/512] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:50:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:41.574781 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076b0d3-1e43-4573-b739-6f3c3497a37b None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:41.704476 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 259/513] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:41 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:41.706148 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd7a89-4a86-484b-bd87-66660da19748 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:41.716633 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076b0d3-1e43-4573-b739-6f3c3497a37b None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:41.727542 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:41.765162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec589730-c7c4-4bec-8d73-d55156d9095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:41.766125 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec589730-c7c4-4bec-8d73-d55156d9095d None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:41.766585 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec589730-c7c4-4bec-8d73-d55156d9095d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:41.766949 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec589730-c7c4-4bec-8d73-d55156d9095d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:41.767785 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec589730-c7c4-4bec-8d73-d55156d9095d None admin] RBAC: Adding query filter params (role.id=7b8b39bfefe4416cab4e766c2cdb6006, scope.project.id=c6af527bb8974bc6915553d99df0901e, user.id=b48c6b8ef7284907bbfd5b48e2b58516) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:41.768462 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec589730-c7c4-4bec-8d73-d55156d9095d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:41.771305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec589730-c7c4-4bec-8d73-d55156d9095d None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:41.781456 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 255/514] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:50:41 2022] GET /identity/v3/role_assignments?user.id=b48c6b8ef7284907bbfd5b48e2b58516&scope.project.id=c6af527bb8974bc6915553d99df0901e&role.id=7b8b39bfefe4416cab4e766c2cdb6006 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:41.782652 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec589730-c7c4-4bec-8d73-d55156d9095d None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:41.839195 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:41.850753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd7a89-4a86-484b-bd87-66660da19748 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:41.900842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15c488-356b-49ad-94d7-1b0a8971f9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:41.901926 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15c488-356b-49ad-94d7-1b0a8971f9db None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:41.902453 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15c488-356b-49ad-94d7-1b0a8971f9db None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:41.902994 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15c488-356b-49ad-94d7-1b0a8971f9db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:41.917331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15c488-356b-49ad-94d7-1b0a8971f9db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:41.921053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15c488-356b-49ad-94d7-1b0a8971f9db None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-7e15c488-356b-49ad-94d7-1b0a8971f9db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:41.946273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:41.947328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:41.948850 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:41.948850 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:41.948850 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:41.949099 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 260/515] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:41.949995 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15c488-356b-49ad-94d7-1b0a8971f9db None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:41.973581 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec589730-c7c4-4bec-8d73-d55156d9095d None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:42.038609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7aac6b-24b1-4b7c-839c-e8860eef4dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:42.039272 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7aac6b-24b1-4b7c-839c-e8860eef4dbb None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:42.039550 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7aac6b-24b1-4b7c-839c-e8860eef4dbb None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:42.039822 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7aac6b-24b1-4b7c-839c-e8860eef4dbb None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:42.040567 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7aac6b-24b1-4b7c-839c-e8860eef4dbb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:42.040872 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7aac6b-24b1-4b7c-839c-e8860eef4dbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:42.042523 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7aac6b-24b1-4b7c-839c-e8860eef4dbb None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:42.076919 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 256/516] 10.222.0.121 () {56 vars in 1144 bytes} [Fri Aug 26 00:50:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:42.078326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7aac6b-24b1-4b7c-839c-e8860eef4dbb None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:42.120888 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15c488-356b-49ad-94d7-1b0a8971f9db None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:42.150527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:42.164031 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002976c-86ea-44b6-bedb-3ea30c2d2258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:42.164711 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002976c-86ea-44b6-bedb-3ea30c2d2258 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:42.164994 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002976c-86ea-44b6-bedb-3ea30c2d2258 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:42.165269 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002976c-86ea-44b6-bedb-3ea30c2d2258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:42.178849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002976c-86ea-44b6-bedb-3ea30c2d2258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:42.180349 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002976c-86ea-44b6-bedb-3ea30c2d2258 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:42.190967 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-4002976c-86ea-44b6-bedb-3ea30c2d2258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:42.200470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:42.213158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:42.214152 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:42.214152 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:42.214152 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:42.214152 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 261/517] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:42.214152 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002976c-86ea-44b6-bedb-3ea30c2d2258 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:42.240452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7aac6b-24b1-4b7c-839c-e8860eef4dbb None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:42.293080 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0d5bc-8921-4935-8e42-fbf2edac2835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:42.293814 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0d5bc-8921-4935-8e42-fbf2edac2835 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:42.294186 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0d5bc-8921-4935-8e42-fbf2edac2835 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:42.294560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0d5bc-8921-4935-8e42-fbf2edac2835 None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:42.295526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0d5bc-8921-4935-8e42-fbf2edac2835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:42.295927 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0d5bc-8921-4935-8e42-fbf2edac2835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:42.297480 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0d5bc-8921-4935-8e42-fbf2edac2835 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:42.324661 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 257/518] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:42.324661 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0d5bc-8921-4935-8e42-fbf2edac2835 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:42.381380 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002976c-86ea-44b6-bedb-3ea30c2d2258 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:42.436223 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29608ec5-7e98-479f-b3ca-636935020bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:42.437533 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29608ec5-7e98-479f-b3ca-636935020bb3 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:42.437533 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29608ec5-7e98-479f-b3ca-636935020bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:42.437533 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29608ec5-7e98-479f-b3ca-636935020bb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:42.480660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:42.498352 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0d5bc-8921-4935-8e42-fbf2edac2835 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:42.520542 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:42.523256 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29608ec5-7e98-479f-b3ca-636935020bb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:42.524760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29608ec5-7e98-479f-b3ca-636935020bb3 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:42.539738 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116258cc-907f-45eb-b21c-a7e1713dbca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:42.540686 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116258cc-907f-45eb-b21c-a7e1713dbca0 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:42.541629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116258cc-907f-45eb-b21c-a7e1713dbca0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:42.541968 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116258cc-907f-45eb-b21c-a7e1713dbca0 None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:42.542626 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116258cc-907f-45eb-b21c-a7e1713dbca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:42.542952 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116258cc-907f-45eb-b21c-a7e1713dbca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:42.544401 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116258cc-907f-45eb-b21c-a7e1713dbca0 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:42.571247 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 258/519] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:42.571247 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116258cc-907f-45eb-b21c-a7e1713dbca0 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:42.699878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 262/520] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:42 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:42.700994 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29608ec5-7e98-479f-b3ca-636935020bb3 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:42.727491 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116258cc-907f-45eb-b21c-a7e1713dbca0 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:42.792156 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8b99e-988c-4eb9-a739-c0c5b7889080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:42.792898 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8b99e-988c-4eb9-a739-c0c5b7889080 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:42.793305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8b99e-988c-4eb9-a739-c0c5b7889080 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:42.793698 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8b99e-988c-4eb9-a739-c0c5b7889080 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:42.802090 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8b99e-988c-4eb9-a739-c0c5b7889080 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:42.804104 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8b99e-988c-4eb9-a739-c0c5b7889080 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:42.820885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-dbd8b99e-988c-4eb9-a739-c0c5b7889080 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:42.820885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:42.820885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:42.820885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:42.820885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:42.820885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:42.820885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:42.820885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:42.820885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:42.820885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:42.820885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:42.820885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:42.820885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:50:42.820885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:50:42.820885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:42.822612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:42.824328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:50:42.824328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:50:42.824328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:50:42.824328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:50:42.824328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:50:42.824328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:50:42.824328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:42.824328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:42.824328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 259/521] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:42.824328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8b99e-988c-4eb9-a739-c0c5b7889080 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:42.851137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:42.881450 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:42.884978 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29608ec5-7e98-479f-b3ca-636935020bb3 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:42.932699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1a691-1a38-4c52-8a58-e823eb1bde54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:42.933752 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1a691-1a38-4c52-8a58-e823eb1bde54 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:42.934455 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1a691-1a38-4c52-8a58-e823eb1bde54 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:42.935130 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1a691-1a38-4c52-8a58-e823eb1bde54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:42.946019 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1a691-1a38-4c52-8a58-e823eb1bde54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:42.947753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1a691-1a38-4c52-8a58-e823eb1bde54 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:42.962016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-37d1a691-1a38-4c52-8a58-e823eb1bde54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:42.962016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:42.962016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:42.962016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:42.962016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:42.962016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:42.962016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:42.962016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:42.962016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:42.962016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:42.962016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:42.962016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:42.962016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:50:42.962016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:50:42.962016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:42.964171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:42.967025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:50:42.967025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:50:42.967025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:50:42.967025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:50:42.967025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:50:42.967025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:50:42.967025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:42.967025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:42.967025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 263/522] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:42.967025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1a691-1a38-4c52-8a58-e823eb1bde54 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:43.025204 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8b99e-988c-4eb9-a739-c0c5b7889080 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:43.088717 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85caa98-da98-4b2b-8e37-f9684ae2b4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:43.089773 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85caa98-da98-4b2b-8e37-f9684ae2b4e9 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:43.090261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85caa98-da98-4b2b-8e37-f9684ae2b4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:43.090745 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85caa98-da98-4b2b-8e37-f9684ae2b4e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:43.110841 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85caa98-da98-4b2b-8e37-f9684ae2b4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:43.113578 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85caa98-da98-4b2b-8e37-f9684ae2b4e9 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-e85caa98-da98-4b2b-8e37-f9684ae2b4e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:43.142629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:43.144582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:43.146097 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:43.146097 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:43.146097 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:43.146097 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 260/523] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:43.146848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1a691-1a38-4c52-8a58-e823eb1bde54 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:43.153435 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85caa98-da98-4b2b-8e37-f9684ae2b4e9 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:43.197001 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f792d-819f-4bd5-ab4c-1584dadafa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:43.198687 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f792d-819f-4bd5-ab4c-1584dadafa7a None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:43.199215 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f792d-819f-4bd5-ab4c-1584dadafa7a None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:43.199713 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f792d-819f-4bd5-ab4c-1584dadafa7a None admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:43.200566 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f792d-819f-4bd5-ab4c-1584dadafa7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:43.200953 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f792d-819f-4bd5-ab4c-1584dadafa7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:43.202562 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f792d-819f-4bd5-ab4c-1584dadafa7a None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:43.225233 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 264/524] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:50:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:43.225233 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f792d-819f-4bd5-ab4c-1584dadafa7a None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:43.262170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:43.274377 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:43.348915 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85caa98-da98-4b2b-8e37-f9684ae2b4e9 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:43.398797 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae9ed8-5bc4-45e2-aade-dc0103cfa7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:43.399789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae9ed8-5bc4-45e2-aade-dc0103cfa7b6 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:43.400260 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae9ed8-5bc4-45e2-aade-dc0103cfa7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:43.400711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae9ed8-5bc4-45e2-aade-dc0103cfa7b6 None admin] PATH_INFO: `/v3/projects` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:43.401556 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae9ed8-5bc4-45e2-aade-dc0103cfa7b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:43.402002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae9ed8-5bc4-45e2-aade-dc0103cfa7b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:43.403904 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae9ed8-5bc4-45e2-aade-dc0103cfa7b6 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:43.424746 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f792d-819f-4bd5-ab4c-1584dadafa7a None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:43.430648 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 261/525] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:50:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:43.431121 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae9ed8-5bc4-45e2-aade-dc0103cfa7b6 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:43.490127 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767c8c-ede7-4415-9493-a48410688e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:43.490880 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767c8c-ede7-4415-9493-a48410688e27 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:43.491210 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767c8c-ede7-4415-9493-a48410688e27 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:43.491864 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767c8c-ede7-4415-9493-a48410688e27 None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:43.492556 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04767c8c-ede7-4415-9493-a48410688e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:43.492903 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04767c8c-ede7-4415-9493-a48410688e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:43.495876 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04767c8c-ede7-4415-9493-a48410688e27 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:43.513493 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 265/526] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:43.514446 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767c8c-ede7-4415-9493-a48410688e27 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:43.634801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae9ed8-5bc4-45e2-aade-dc0103cfa7b6 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:43.670793 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:43.681630 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:43.693952 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fe6af-886e-4924-b003-a2759cbe340b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:43.694619 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fe6af-886e-4924-b003-a2759cbe340b None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:43.694932 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fe6af-886e-4924-b003-a2759cbe340b None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:43.695206 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fe6af-886e-4924-b003-a2759cbe340b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:43.695961 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fe6af-886e-4924-b003-a2759cbe340b None admin] RBAC: Adding query filter params (role.id=7b8b39bfefe4416cab4e766c2cdb6006, scope.project.id=c6af527bb8974bc6915553d99df0901e, user.id=9a64697b77c04100934d5bd91cb321ed) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:43.696266 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fe6af-886e-4924-b003-a2759cbe340b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:43.698488 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fe6af-886e-4924-b003-a2759cbe340b None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:43.714856 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 262/527] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:50:43 2022] GET /identity/v3/role_assignments?user.id=9a64697b77c04100934d5bd91cb321ed&scope.project.id=c6af527bb8974bc6915553d99df0901e&role.id=7b8b39bfefe4416cab4e766c2cdb6006 => generated 260 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:43.714856 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fe6af-886e-4924-b003-a2759cbe340b None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:43.730705 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767c8c-ede7-4415-9493-a48410688e27 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:43.780430 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de384726-da22-4f6a-b45a-bd52cdffa300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:43.781190 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de384726-da22-4f6a-b45a-bd52cdffa300 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:43.781776 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de384726-da22-4f6a-b45a-bd52cdffa300 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:43.782193 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de384726-da22-4f6a-b45a-bd52cdffa300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:43.783009 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de384726-da22-4f6a-b45a-bd52cdffa300 None admin] RBAC: Adding query filter params (role.id=7b8b39bfefe4416cab4e766c2cdb6006, scope.project.id=c6af527bb8974bc6915553d99df0901e, user.id=4fe450e040874be58ea27dd47c3ff7a4) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:43.783502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de384726-da22-4f6a-b45a-bd52cdffa300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:43.785022 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de384726-da22-4f6a-b45a-bd52cdffa300 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:43.802434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 266/528] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:50:43 2022] GET /identity/v3/role_assignments?user.id=4fe450e040874be58ea27dd47c3ff7a4&scope.project.id=c6af527bb8974bc6915553d99df0901e&role.id=7b8b39bfefe4416cab4e766c2cdb6006 => generated 260 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:43.936422 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fe6af-886e-4924-b003-a2759cbe340b None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:44.007016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163b59a-628d-4f0f-9120-22aeb35e0118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:44.008085 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b59a-628d-4f0f-9120-22aeb35e0118 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:44.008532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b59a-628d-4f0f-9120-22aeb35e0118 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:44.008943 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b59a-628d-4f0f-9120-22aeb35e0118 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:44.021295 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163b59a-628d-4f0f-9120-22aeb35e0118 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:44.024087 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163b59a-628d-4f0f-9120-22aeb35e0118 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:44.045863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-3163b59a-628d-4f0f-9120-22aeb35e0118 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:44.045863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:44.045863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:44.045863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:44.045863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:44.045863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:44.045863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:44.045863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:44.045863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:44.045863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:44.045863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:44.045863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:44.045863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:50:44.045863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:50:44.045863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:44.048175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:44.049877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:50:44.049877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:50:44.049877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:50:44.049877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:50:44.049877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:50:44.049877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:50:44.049877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:44.049877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:44.054874 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 263/529] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:44.063986 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de384726-da22-4f6a-b45a-bd52cdffa300 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:44.186663 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de384726-da22-4f6a-b45a-bd52cdffa300 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:44.229398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935c3f1-2d4c-4aee-9c8e-c2aba06d97e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:44.230028 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935c3f1-2d4c-4aee-9c8e-c2aba06d97e7 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:44.230311 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935c3f1-2d4c-4aee-9c8e-c2aba06d97e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:44.230584 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935c3f1-2d4c-4aee-9c8e-c2aba06d97e7 None admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:44.231339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935c3f1-2d4c-4aee-9c8e-c2aba06d97e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:44.231644 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935c3f1-2d4c-4aee-9c8e-c2aba06d97e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:44.233137 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935c3f1-2d4c-4aee-9c8e-c2aba06d97e7 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:44.248154 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 267/530] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:50:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:44.254224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163b59a-628d-4f0f-9120-22aeb35e0118 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:44.311211 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:44.347169 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974412b-23d7-4525-986c-3904f4b35121 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:44.347456 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974412b-23d7-4525-986c-3904f4b35121 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:44.347731 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974412b-23d7-4525-986c-3904f4b35121 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:44.349398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 268/531] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:44.355088 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5037c6-e93f-413a-9fb2-6f0091da9564 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:44.355366 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5037c6-e93f-413a-9fb2-6f0091da9564 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:44.355641 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5037c6-e93f-413a-9fb2-6f0091da9564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:44.363779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:44.377868 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-6a5037c6-e93f-413a-9fb2-6f0091da9564 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:44.379767 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-6a5037c6-e93f-413a-9fb2-6f0091da9564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:44.383116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163b59a-628d-4f0f-9120-22aeb35e0118 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:44.430804 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474be974-2650-4853-ad44-2335ba24f46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:44.431460 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474be974-2650-4853-ad44-2335ba24f46d None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:44.432348 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474be974-2650-4853-ad44-2335ba24f46d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:44.432635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474be974-2650-4853-ad44-2335ba24f46d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:44.433563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474be974-2650-4853-ad44-2335ba24f46d None admin] RBAC: Adding query filter params (role.id=7b8b39bfefe4416cab4e766c2cdb6006, scope.project.id=c6af527bb8974bc6915553d99df0901e, user.id=8b2d08cc51074be0801fd5df03e3e7b2) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:44.433877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474be974-2650-4853-ad44-2335ba24f46d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:44.435678 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474be974-2650-4853-ad44-2335ba24f46d None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:44.447180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 264/532] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:50:44 2022] GET /identity/v3/role_assignments?user.id=8b2d08cc51074be0801fd5df03e3e7b2&scope.project.id=c6af527bb8974bc6915553d99df0901e&role.id=7b8b39bfefe4416cab4e766c2cdb6006 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:44.480591 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 269/533] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:50:44.849342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474be974-2650-4853-ad44-2335ba24f46d None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:44.972295 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474be974-2650-4853-ad44-2335ba24f46d None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:44.999760 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:45.032565 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8a87-4394-4000-9b5b-b8c7b595e344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:45.033366 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8a87-4394-4000-9b5b-b8c7b595e344 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:45.033768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8a87-4394-4000-9b5b-b8c7b595e344 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:45.034221 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8a87-4394-4000-9b5b-b8c7b595e344 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:45.050537 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e8a87-4394-4000-9b5b-b8c7b595e344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-339e8a87-4394-4000-9b5b-b8c7b595e344 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:45.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:45.060342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:45.063191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:45.063191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:45.063191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:45.063191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:45.063191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:45.063191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:45.063191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:45.063191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:45.063191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:45.063191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:45.063191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:45.063191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:45.068613 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 265/534] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:50:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:45.076406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5037c6-e93f-413a-9fb2-6f0091da9564 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:45.197945 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5037c6-e93f-413a-9fb2-6f0091da9564 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:45.239297 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad434a0d-8c5c-49a2-bcbc-01ce9c216298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:45.239953 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad434a0d-8c5c-49a2-bcbc-01ce9c216298 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:45.240226 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad434a0d-8c5c-49a2-bcbc-01ce9c216298 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:45.240485 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad434a0d-8c5c-49a2-bcbc-01ce9c216298 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:45.241158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad434a0d-8c5c-49a2-bcbc-01ce9c216298 None admin] RBAC: Adding query filter params (name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:45.241455 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad434a0d-8c5c-49a2-bcbc-01ce9c216298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:45.242879 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad434a0d-8c5c-49a2-bcbc-01ce9c216298 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:45.244790 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:45.253450 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 270/535] 10.222.0.121 () {56 vars in 1108 bytes} [Fri Aug 26 00:50:45 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:45.259200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8a87-4394-4000-9b5b-b8c7b595e344 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:45.455745 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8a87-4394-4000-9b5b-b8c7b595e344 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:45.496262 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3d3da-6e68-45ec-96e6-4c77eb175a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:45.496904 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3d3da-6e68-45ec-96e6-4c77eb175a77 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:45.497180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3d3da-6e68-45ec-96e6-4c77eb175a77 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:45.497449 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3d3da-6e68-45ec-96e6-4c77eb175a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:45.510365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3d3da-6e68-45ec-96e6-4c77eb175a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:45.511898 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3d3da-6e68-45ec-96e6-4c77eb175a77 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-03d3d3da-6e68-45ec-96e6-4c77eb175a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:45.529800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:45.533149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:45.535610 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:45.535610 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:45.535610 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:45.535610 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 266/536] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:50:45.541591 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad434a0d-8c5c-49a2-bcbc-01ce9c216298 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:45.749642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad434a0d-8c5c-49a2-bcbc-01ce9c216298 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:45.803173 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbc2a3-bce5-4dfa-8cfa-44f77651f773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:45.803799 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbc2a3-bce5-4dfa-8cfa-44f77651f773 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:45.804077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbc2a3-bce5-4dfa-8cfa-44f77651f773 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:45.804351 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbc2a3-bce5-4dfa-8cfa-44f77651f773 None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:45.805022 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbc2a3-bce5-4dfa-8cfa-44f77651f773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:45.805324 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbc2a3-bce5-4dfa-8cfa-44f77651f773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:45.807467 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbc2a3-bce5-4dfa-8cfa-44f77651f773 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:45.822754 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 271/537] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:45.831003 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3d3da-6e68-45ec-96e6-4c77eb175a77 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:45.860857 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:45.956587 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3d3da-6e68-45ec-96e6-4c77eb175a77 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:45.999174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc7a25-5d11-4d81-9619-102edcfb64f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:46.000217 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc7a25-5d11-4d81-9619-102edcfb64f0 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:46.000459 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc7a25-5d11-4d81-9619-102edcfb64f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:46.000813 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc7a25-5d11-4d81-9619-102edcfb64f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:46.009533 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc7a25-5d11-4d81-9619-102edcfb64f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:46.011114 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc7a25-5d11-4d81-9619-102edcfb64f0 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-7acc7a25-5d11-4d81-9619-102edcfb64f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:50:46.024618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:46.028147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:46.034261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:46.034261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:46.034261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:50:46.034261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:50:46.034261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:50:46.034261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:50:46.034261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:50:46.034261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:50:46.034261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:50:46.034261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:46.034261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 267/538] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:46.037531 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbc2a3-bce5-4dfa-8cfa-44f77651f773 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:46.121057 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:46.173972 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbc2a3-bce5-4dfa-8cfa-44f77651f773 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:46.218573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a31f8-0bb3-4137-9213-17fd31517421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:46.219754 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a31f8-0bb3-4137-9213-17fd31517421 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:46.219754 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a31f8-0bb3-4137-9213-17fd31517421 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:46.219754 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a31f8-0bb3-4137-9213-17fd31517421 None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:46.222869 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a31f8-0bb3-4137-9213-17fd31517421 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:46.222869 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a31f8-0bb3-4137-9213-17fd31517421 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:46.222869 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a31f8-0bb3-4137-9213-17fd31517421 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:46.231584 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3cd4c-8e54-4a75-9f3c-d05566e8101e None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:46.232527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3cd4c-8e54-4a75-9f3c-d05566e8101e None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:46.232527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3cd4c-8e54-4a75-9f3c-d05566e8101e None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:46.234328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 268/539] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:46.240458 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dad65-e0cd-430e-a4a6-76ffb7fa82c6 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:46.240888 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dad65-e0cd-430e-a4a6-76ffb7fa82c6 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:46.240888 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dad65-e0cd-430e-a4a6-76ffb7fa82c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:46.248135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 272/540] 10.222.0.121 () {56 vars in 1142 bytes} [Fri Aug 26 00:50:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:46.253717 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a31f8-0bb3-4137-9213-17fd31517421 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:46.264224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-f45dad65-e0cd-430e-a4a6-76ffb7fa82c6 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:46.265493 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-f45dad65-e0cd-430e-a4a6-76ffb7fa82c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:46.362042 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 269/541] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:46.403609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a31f8-0bb3-4137-9213-17fd31517421 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:46.435261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:46.448305 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d112356-06c5-4644-bcfb-79149e29c7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:46.449098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d112356-06c5-4644-bcfb-79149e29c7c0 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:46.449396 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d112356-06c5-4644-bcfb-79149e29c7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:46.449657 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d112356-06c5-4644-bcfb-79149e29c7c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:46.463038 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d112356-06c5-4644-bcfb-79149e29c7c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:46.464549 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d112356-06c5-4644-bcfb-79149e29c7c0 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-9d112356-06c5-4644-bcfb-79149e29c7c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:46.483963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:46.486917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:46.490017 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:46.490017 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:46.490017 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:46.490017 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 273/542] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:46.495996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dad65-e0cd-430e-a4a6-76ffb7fa82c6 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:46.523363 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:46.619418 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dad65-e0cd-430e-a4a6-76ffb7fa82c6 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:46.669652 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baa671-16a8-4722-97a2-407f493dff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:46.671346 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baa671-16a8-4722-97a2-407f493dff35 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:46.672052 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baa671-16a8-4722-97a2-407f493dff35 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:46.672761 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baa671-16a8-4722-97a2-407f493dff35 None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:46.673871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baa671-16a8-4722-97a2-407f493dff35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:46.674591 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baa671-16a8-4722-97a2-407f493dff35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:46.677343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baa671-16a8-4722-97a2-407f493dff35 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:46.698487 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 270/543] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:46.707441 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d112356-06c5-4644-bcfb-79149e29c7c0 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:46.708259 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baa671-16a8-4722-97a2-407f493dff35 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:46.808270 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:46.847339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baa671-16a8-4722-97a2-407f493dff35 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:46.901656 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0f7a9-54eb-4b33-9014-3decc762dee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:46.902328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0f7a9-54eb-4b33-9014-3decc762dee4 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:46.902610 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0f7a9-54eb-4b33-9014-3decc762dee4 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:46.902908 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0f7a9-54eb-4b33-9014-3decc762dee4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:46.917365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0f7a9-54eb-4b33-9014-3decc762dee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:46.919287 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d112356-06c5-4644-bcfb-79149e29c7c0 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-c4e0f7a9-54eb-4b33-9014-3decc762dee4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:46.923198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:46.924896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:46.926439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:46.926439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:46.926439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:46.926439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:46.926439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:46.926439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:46.926439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:46.926439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:46.926439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:46.926439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:46.926439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:46.926439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:46.926439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 271/544] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:50:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:46.934177 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0f7a9-54eb-4b33-9014-3decc762dee4 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:46.984404 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70f5bd-5973-4af9-b75b-47020f8a6b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:46.985100 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70f5bd-5973-4af9-b75b-47020f8a6b65 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:46.985385 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70f5bd-5973-4af9-b75b-47020f8a6b65 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:46.985669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70f5bd-5973-4af9-b75b-47020f8a6b65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:47.005469 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70f5bd-5973-4af9-b75b-47020f8a6b65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:47.011100 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70f5bd-5973-4af9-b75b-47020f8a6b65 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:47.038540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-bd70f5bd-5973-4af9-b75b-47020f8a6b65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:47.038540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:47.038540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:47.038540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:47.038540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:47.038540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:47.038540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:47.038540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:47.038540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:47.038540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:47.038540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:47.038540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:47.038540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:50:47.038540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:50:47.038540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:47.039506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:47.040338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:50:47.040338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:50:47.040338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:50:47.040338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:50:47.040338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:50:47.040338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:50:47.040338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:47.040338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:47.048578 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 274/545] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:47.050071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70f5bd-5973-4af9-b75b-47020f8a6b65 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:47.096190 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:47.155921 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0f7a9-54eb-4b33-9014-3decc762dee4 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:47.196619 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:47.203817 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd27e0c-e2f7-4a32-8288-3e9088200bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:47.204510 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd27e0c-e2f7-4a32-8288-3e9088200bd0 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:47.204829 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd27e0c-e2f7-4a32-8288-3e9088200bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:47.205106 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd27e0c-e2f7-4a32-8288-3e9088200bd0 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:47.205799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd27e0c-e2f7-4a32-8288-3e9088200bd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:47.206098 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd27e0c-e2f7-4a32-8288-3e9088200bd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:47.207596 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd27e0c-e2f7-4a32-8288-3e9088200bd0 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:47.217066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 272/546] 10.222.0.121 () {56 vars in 1108 bytes} [Fri Aug 26 00:50:46 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:47.218463 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057274e3-c9a9-4b2f-98bf-669aa488efd0 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:47.218750 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057274e3-c9a9-4b2f-98bf-669aa488efd0 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:47.219061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057274e3-c9a9-4b2f-98bf-669aa488efd0 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:47.220690 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 273/547] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:47.223181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4b0cc-6e30-4566-ada0-082205a56335 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:47.223465 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4b0cc-6e30-4566-ada0-082205a56335 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:47.223735 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4b0cc-6e30-4566-ada0-082205a56335 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:47.225187 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 274/548] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:47 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:47.226039 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4b0cc-6e30-4566-ada0-082205a56335 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:47.227426 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70f5bd-5973-4af9-b75b-47020f8a6b65 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:47.272693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c4985-3350-4b26-9619-a8b33958646a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:47.273390 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c4985-3350-4b26-9619-a8b33958646a None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:47.273681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c4985-3350-4b26-9619-a8b33958646a None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:47.273949 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c4985-3350-4b26-9619-a8b33958646a None admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:47.274659 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c4985-3350-4b26-9619-a8b33958646a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:47.275270 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c4985-3350-4b26-9619-a8b33958646a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:47.276596 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c4985-3350-4b26-9619-a8b33958646a None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:47.299011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 275/549] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:50:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:47.299011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3c790-3d19-48ed-992a-f2c1ba17986b None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:47.299011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3c790-3d19-48ed-992a-f2c1ba17986b None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:47.299011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3c790-3d19-48ed-992a-f2c1ba17986b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:47.321589 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-eec3c790-3d19-48ed-992a-f2c1ba17986b None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:47.323443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-eec3c790-3d19-48ed-992a-f2c1ba17986b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:47.410589 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4b0cc-6e30-4566-ada0-082205a56335 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:47.412560 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 276/550] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:47.414885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46e4fc-ae81-4e6d-b2b7-6b72b62fcc7a None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:47.415388 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46e4fc-ae81-4e6d-b2b7-6b72b62fcc7a None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:47.415943 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46e4fc-ae81-4e6d-b2b7-6b72b62fcc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:47.456443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-1c46e4fc-ae81-4e6d-b2b7-6b72b62fcc7a None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:47.458677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-1c46e4fc-ae81-4e6d-b2b7-6b72b62fcc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:47.483502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:47.508206 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee37dd2-b595-4989-b2ad-6f4655e3784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:47.508864 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee37dd2-b595-4989-b2ad-6f4655e3784d None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:47.509147 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee37dd2-b595-4989-b2ad-6f4655e3784d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:47.509427 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee37dd2-b595-4989-b2ad-6f4655e3784d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:47.528695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee37dd2-b595-4989-b2ad-6f4655e3784d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:47.531490 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee37dd2-b595-4989-b2ad-6f4655e3784d None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-0ee37dd2-b595-4989-b2ad-6f4655e3784d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:47.556953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:47.558609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:47.559816 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:47.559816 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:47.559816 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:47.570890 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 275/551] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:47.570890 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee37dd2-b595-4989-b2ad-6f4655e3784d None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:47.575139 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 277/552] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:47.575792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46e4fc-ae81-4e6d-b2b7-6b72b62fcc7a None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:47.659048 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:47.752043 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee37dd2-b595-4989-b2ad-6f4655e3784d None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:47.758643 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46e4fc-ae81-4e6d-b2b7-6b72b62fcc7a None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:47.811916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc81126-884b-4972-b88d-31d3066ba86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:47.813055 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc81126-884b-4972-b88d-31d3066ba86f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:47.813550 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc81126-884b-4972-b88d-31d3066ba86f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:47.814029 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc81126-884b-4972-b88d-31d3066ba86f None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:47.814931 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc81126-884b-4972-b88d-31d3066ba86f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:47.815444 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc81126-884b-4972-b88d-31d3066ba86f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:47.817197 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc81126-884b-4972-b88d-31d3066ba86f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:47.817793 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476ef0b-358e-4ee5-aea2-6d08c9d40e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:47.819297 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476ef0b-358e-4ee5-aea2-6d08c9d40e3a None admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:47.819797 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476ef0b-358e-4ee5-aea2-6d08c9d40e3a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:47.820275 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476ef0b-358e-4ee5-aea2-6d08c9d40e3a None admin] PATH_INFO: `/v3/projects/c6af527bb8974bc6915553d99df0901e/users/b48c6b8ef7284907bbfd5b48e2b58516/roles/7b8b39bfefe4416cab4e766c2cdb6006` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:47.839178 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 278/553] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:47.840573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc81126-884b-4972-b88d-31d3066ba86f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:47.851430 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476ef0b-358e-4ee5-aea2-6d08c9d40e3a None admin] RBAC: Authorizing `identity:create_grant(project_id=c6af527bb8974bc6915553d99df0901e, user_id=b48c6b8ef7284907bbfd5b48e2b58516, role_id=7b8b39bfefe4416cab4e766c2cdb6006)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:47.854506 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476ef0b-358e-4ee5-aea2-6d08c9d40e3a None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:47.855141 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:47.966969 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc81126-884b-4972-b88d-31d3066ba86f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:47.975936 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 276/554] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:50:47 2022] PUT /identity/v3/projects/c6af527bb8974bc6915553d99df0901e/users/b48c6b8ef7284907bbfd5b48e2b58516/roles/7b8b39bfefe4416cab4e766c2cdb6006 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:50:47.976778 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476ef0b-358e-4ee5-aea2-6d08c9d40e3a None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:48.028519 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172422c-a32f-44e0-aff0-ec8aa9b957ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:48.029424 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172422c-a32f-44e0-aff0-ec8aa9b957ee None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:48.029913 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172422c-a32f-44e0-aff0-ec8aa9b957ee None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:48.030385 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172422c-a32f-44e0-aff0-ec8aa9b957ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:48.053328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172422c-a32f-44e0-aff0-ec8aa9b957ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-0172422c-a32f-44e0-aff0-ec8aa9b957ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:48.063240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:48.064333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:48.065138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:48.065138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:48.065138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:48.065138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:48.065138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:48.065138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:48.065138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:48.065138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:48.065138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:48.065138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:48.065138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:48.065138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:48.065138 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 279/555] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:50:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:48.066740 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172422c-a32f-44e0-aff0-ec8aa9b957ee None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:48.144722 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:48.153722 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476ef0b-358e-4ee5-aea2-6d08c9d40e3a None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:48.168137 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:48.198855 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c1be7-2f6b-4186-a4fc-71c7d3bf3611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:48.199510 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c1be7-2f6b-4186-a4fc-71c7d3bf3611 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:48.199915 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c1be7-2f6b-4186-a4fc-71c7d3bf3611 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:48.200163 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c1be7-2f6b-4186-a4fc-71c7d3bf3611 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:48.208775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c1be7-2f6b-4186-a4fc-71c7d3bf3611 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:48.210323 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c1be7-2f6b-4186-a4fc-71c7d3bf3611 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:48.218900 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172422c-a32f-44e0-aff0-ec8aa9b957ee None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-370c1be7-2f6b-4186-a4fc-71c7d3bf3611 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:50:48.226353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:48.228311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:48.231906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:48.231906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:48.231906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:50:48.231906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:50:48.231906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:50:48.231906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:50:48.231906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:50:48.231906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:50:48.231906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:50:48.231906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:48.231906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 277/556] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:48.231906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c1be7-2f6b-4186-a4fc-71c7d3bf3611 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:48.283888 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9a97e-7dea-432f-b07e-b12e1dfb018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:48.284813 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9a97e-7dea-432f-b07e-b12e1dfb018b None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:48.285179 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9a97e-7dea-432f-b07e-b12e1dfb018b None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:48.285528 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9a97e-7dea-432f-b07e-b12e1dfb018b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:48.311855 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9a97e-7dea-432f-b07e-b12e1dfb018b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-23f9a97e-7dea-432f-b07e-b12e1dfb018b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:48.319092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:48.320940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:48.325506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:48.325506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:48.325506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:48.325506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:48.325506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:48.325506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:48.325506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:48.325506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:48.325506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:48.325506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:48.325506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:48.325506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:48.325506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 280/557] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:50:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:48.325506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9a97e-7dea-432f-b07e-b12e1dfb018b None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:48.395567 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c1be7-2f6b-4186-a4fc-71c7d3bf3611 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:48.445921 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce835e1d-b6b2-4b83-b8ca-258e2db94502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:48.447607 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce835e1d-b6b2-4b83-b8ca-258e2db94502 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:48.448596 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce835e1d-b6b2-4b83-b8ca-258e2db94502 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:48.449062 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce835e1d-b6b2-4b83-b8ca-258e2db94502 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:48.450157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce835e1d-b6b2-4b83-b8ca-258e2db94502 None admin] RBAC: Adding query filter params (name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:48.450660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce835e1d-b6b2-4b83-b8ca-258e2db94502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:48.453122 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce835e1d-b6b2-4b83-b8ca-258e2db94502 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:48.468396 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 278/558] 10.222.0.121 () {56 vars in 1108 bytes} [Fri Aug 26 00:50:48 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:48.469649 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce835e1d-b6b2-4b83-b8ca-258e2db94502 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:48.485129 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9a97e-7dea-432f-b07e-b12e1dfb018b None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:48.498145 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:48.519034 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:48.531167 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88c2ce-1c06-407f-a405-15d8476ef34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:48.531939 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88c2ce-1c06-407f-a405-15d8476ef34e None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:48.532552 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88c2ce-1c06-407f-a405-15d8476ef34e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:48.532978 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88c2ce-1c06-407f-a405-15d8476ef34e None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:48.537911 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88c2ce-1c06-407f-a405-15d8476ef34e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:48.537911 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88c2ce-1c06-407f-a405-15d8476ef34e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:48.537911 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88c2ce-1c06-407f-a405-15d8476ef34e None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:48.566859 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 281/559] 10.222.0.121 () {56 vars in 1142 bytes} [Fri Aug 26 00:50:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:48.566859 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88c2ce-1c06-407f-a405-15d8476ef34e None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:48.620074 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce835e1d-b6b2-4b83-b8ca-258e2db94502 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:48.663376 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6a986-557d-4f58-86c6-7f5685eac59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:48.664149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6a986-557d-4f58-86c6-7f5685eac59a None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:48.664521 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6a986-557d-4f58-86c6-7f5685eac59a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:48.664909 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6a986-557d-4f58-86c6-7f5685eac59a None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:48.665765 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6a986-557d-4f58-86c6-7f5685eac59a None admin] RBAC: Adding query filter params (name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:48.666222 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6a986-557d-4f58-86c6-7f5685eac59a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:48.667938 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6a986-557d-4f58-86c6-7f5685eac59a None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:48.683891 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 279/560] 10.222.0.121 () {56 vars in 1108 bytes} [Fri Aug 26 00:50:48 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:48.684966 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6a986-557d-4f58-86c6-7f5685eac59a None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:48.728264 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88c2ce-1c06-407f-a405-15d8476ef34e None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:48.775303 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5a006-0925-46bc-b04e-c5f150421f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:48.776330 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5a006-0925-46bc-b04e-c5f150421f4d None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:48.776760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5a006-0925-46bc-b04e-c5f150421f4d None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:48.777178 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5a006-0925-46bc-b04e-c5f150421f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:48.797560 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5a006-0925-46bc-b04e-c5f150421f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:48.797560 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5a006-0925-46bc-b04e-c5f150421f4d None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:48.802705 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-c2d5a006-0925-46bc-b04e-c5f150421f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:48.814250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:48.815319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:48.816677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:48.816677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:48.816677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:48.816677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 282/561] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:48.818004 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5a006-0925-46bc-b04e-c5f150421f4d None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:48.841390 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6a986-557d-4f58-86c6-7f5685eac59a None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:48.879677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:48.884593 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cdc1d-a455-4ed3-aaf5-001d7e43183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:48.885293 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cdc1d-a455-4ed3-aaf5-001d7e43183c None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:48.885629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cdc1d-a455-4ed3-aaf5-001d7e43183c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:48.885898 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cdc1d-a455-4ed3-aaf5-001d7e43183c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:48.898778 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cdc1d-a455-4ed3-aaf5-001d7e43183c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:48.900853 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cdc1d-a455-4ed3-aaf5-001d7e43183c None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-f39cdc1d-a455-4ed3-aaf5-001d7e43183c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:48.922563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:48.923660 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:48.924804 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:48.924804 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:48.924804 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:48.924804 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 280/562] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:48.924804 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cdc1d-a455-4ed3-aaf5-001d7e43183c None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:48.972217 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5a006-0925-46bc-b04e-c5f150421f4d None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:49.015023 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ce372-f922-484e-ba38-b188fc6db0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:49.015671 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ce372-f922-484e-ba38-b188fc6db0c1 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:49.015954 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ce372-f922-484e-ba38-b188fc6db0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:49.016372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ce372-f922-484e-ba38-b188fc6db0c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:49.033561 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ce372-f922-484e-ba38-b188fc6db0c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:49.035090 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ce372-f922-484e-ba38-b188fc6db0c1 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-de9ce372-f922-484e-ba38-b188fc6db0c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:49.051725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:49.052699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:49.053653 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:49.053653 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:49.053653 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:49.055506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 283/563] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:49.057251 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ce372-f922-484e-ba38-b188fc6db0c1 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:49.064410 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cdc1d-a455-4ed3-aaf5-001d7e43183c None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:49.109262 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:49.116316 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6d84b-0f01-4e7d-a8a8-4fc7f202f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:49.116958 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6d84b-0f01-4e7d-a8a8-4fc7f202f53c None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:49.117243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6d84b-0f01-4e7d-a8a8-4fc7f202f53c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:49.118724 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6d84b-0f01-4e7d-a8a8-4fc7f202f53c None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:49.118724 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6d84b-0f01-4e7d-a8a8-4fc7f202f53c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:49.121087 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6d84b-0f01-4e7d-a8a8-4fc7f202f53c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:49.121863 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6d84b-0f01-4e7d-a8a8-4fc7f202f53c None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:49.146864 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 281/564] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:49.146864 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6d84b-0f01-4e7d-a8a8-4fc7f202f53c None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:49.189248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:49.207568 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ce372-f922-484e-ba38-b188fc6db0c1 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:49.266972 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b868f-40a9-4cc5-965a-8e1dc0c5066f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:49.267939 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b868f-40a9-4cc5-965a-8e1dc0c5066f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:49.268390 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b868f-40a9-4cc5-965a-8e1dc0c5066f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:49.268829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b868f-40a9-4cc5-965a-8e1dc0c5066f None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:49.269898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b868f-40a9-4cc5-965a-8e1dc0c5066f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:49.270385 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b868f-40a9-4cc5-965a-8e1dc0c5066f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:49.273035 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b868f-40a9-4cc5-965a-8e1dc0c5066f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:49.294943 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 284/565] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:49.295844 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b868f-40a9-4cc5-965a-8e1dc0c5066f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:49.340475 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6d84b-0f01-4e7d-a8a8-4fc7f202f53c None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:49.403227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b622c-02b0-45ba-a230-49786eb7c617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:49.404118 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b622c-02b0-45ba-a230-49786eb7c617 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:49.404453 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b622c-02b0-45ba-a230-49786eb7c617 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:49.404788 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b622c-02b0-45ba-a230-49786eb7c617 None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:49.405512 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b622c-02b0-45ba-a230-49786eb7c617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:49.405886 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b622c-02b0-45ba-a230-49786eb7c617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:49.407459 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b622c-02b0-45ba-a230-49786eb7c617 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:49.426503 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 282/566] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:49.426503 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b622c-02b0-45ba-a230-49786eb7c617 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:49.469580 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b868f-40a9-4cc5-965a-8e1dc0c5066f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:49.521100 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:49.534042 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d66eb-6b44-4888-a057-de3ce8db6e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:49.534924 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d66eb-6b44-4888-a057-de3ce8db6e9f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:49.535372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d66eb-6b44-4888-a057-de3ce8db6e9f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:49.535723 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d66eb-6b44-4888-a057-de3ce8db6e9f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:49.549711 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d66eb-6b44-4888-a057-de3ce8db6e9f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:49.552469 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d66eb-6b44-4888-a057-de3ce8db6e9f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-a72d66eb-6b44-4888-a057-de3ce8db6e9f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:50:49.576912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:49.578074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:49.579281 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:49.579281 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:49.579281 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:50:49.579281 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:50:49.579281 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:50:49.579281 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:50:49.579281 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:50:49.579281 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:50:49.579281 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:50:49.579281 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:49.581665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 285/567] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:50:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:49.582614 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d66eb-6b44-4888-a057-de3ce8db6e9f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:49.609085 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:49.620906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b622c-02b0-45ba-a230-49786eb7c617 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:49.664395 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3ea31-2277-41e7-a9b5-db7ff2ffc504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:49.665249 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3ea31-2277-41e7-a9b5-db7ff2ffc504 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:49.665633 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3ea31-2277-41e7-a9b5-db7ff2ffc504 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:49.665979 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3ea31-2277-41e7-a9b5-db7ff2ffc504 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:49.674810 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3ea31-2277-41e7-a9b5-db7ff2ffc504 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:49.676463 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3ea31-2277-41e7-a9b5-db7ff2ffc504 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:49.690176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-c9d3ea31-2277-41e7-a9b5-db7ff2ffc504 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:49.690176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:49.690176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:49.690176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:49.690176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:49.690176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:49.690176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:49.690176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:49.690176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:49.690176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:49.690176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:49.690176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:49.690176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:50:49.690176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:50:49.690176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:49.692148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:49.694267 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:50:49.694267 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:50:49.694267 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:50:49.694267 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:50:49.694267 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:50:49.694267 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:50:49.694267 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:49.694267 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:49.694267 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 283/568] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:49.695372 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3ea31-2277-41e7-a9b5-db7ff2ffc504 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:49.747454 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d66eb-6b44-4888-a057-de3ce8db6e9f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:49.795832 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893328a-2a76-43ea-9a09-f4b61f393b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:49.796698 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893328a-2a76-43ea-9a09-f4b61f393b23 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:49.797104 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893328a-2a76-43ea-9a09-f4b61f393b23 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:49.797575 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893328a-2a76-43ea-9a09-f4b61f393b23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:49.810140 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893328a-2a76-43ea-9a09-f4b61f393b23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:49.811918 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893328a-2a76-43ea-9a09-f4b61f393b23 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-9893328a-2a76-43ea-9a09-f4b61f393b23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:50:49.825362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:49.827166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:49.828722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:49.828722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:49.828722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:50:49.828722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:50:49.828722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:50:49.828722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:50:49.828722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:50:49.828722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:50:49.828722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:50:49.828722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:49.828722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 286/569] 10.222.0.121 () {56 vars in 1098 bytes} [Fri Aug 26 00:50:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:49.828722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893328a-2a76-43ea-9a09-f4b61f393b23 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:49.850569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3ea31-2277-41e7-a9b5-db7ff2ffc504 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:49.876105 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:49.921318 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86b2e2-4c34-4a74-8e82-eb8e977f0b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:49.922406 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86b2e2-4c34-4a74-8e82-eb8e977f0b15 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:49.923339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86b2e2-4c34-4a74-8e82-eb8e977f0b15 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:49.924798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86b2e2-4c34-4a74-8e82-eb8e977f0b15 None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:49.926366 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86b2e2-4c34-4a74-8e82-eb8e977f0b15 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:49.926944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86b2e2-4c34-4a74-8e82-eb8e977f0b15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:49.929740 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:49.930628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86b2e2-4c34-4a74-8e82-eb8e977f0b15 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:49.969157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 284/570] 10.222.0.121 () {56 vars in 1144 bytes} [Fri Aug 26 00:50:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:49.970356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86b2e2-4c34-4a74-8e82-eb8e977f0b15 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:49.984159 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893328a-2a76-43ea-9a09-f4b61f393b23 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:50.043445 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49559f3a-f2ce-43fd-bb05-30562f629259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:50.044260 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559f3a-f2ce-43fd-bb05-30562f629259 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:50.044687 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559f3a-f2ce-43fd-bb05-30562f629259 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:50.045758 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559f3a-f2ce-43fd-bb05-30562f629259 None admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:50.046311 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49559f3a-f2ce-43fd-bb05-30562f629259 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:50.046747 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49559f3a-f2ce-43fd-bb05-30562f629259 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:50.048545 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49559f3a-f2ce-43fd-bb05-30562f629259 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:50.065653 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 287/571] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:50:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:50.071240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49559f3a-f2ce-43fd-bb05-30562f629259 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:50.156048 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86b2e2-4c34-4a74-8e82-eb8e977f0b15 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:50.205851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897e496-dab8-455f-b45f-6de84a5444ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:50.206851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897e496-dab8-455f-b45f-6de84a5444ba None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:50.207301 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897e496-dab8-455f-b45f-6de84a5444ba None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:50.207713 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897e496-dab8-455f-b45f-6de84a5444ba None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:50.208724 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897e496-dab8-455f-b45f-6de84a5444ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:50.209315 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897e496-dab8-455f-b45f-6de84a5444ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:50.210864 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897e496-dab8-455f-b45f-6de84a5444ba None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:50.219846 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49559f3a-f2ce-43fd-bb05-30562f629259 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:50.233475 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 285/572] 10.222.0.121 () {56 vars in 1138 bytes} [Fri Aug 26 00:50:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:50.234190 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897e496-dab8-455f-b45f-6de84a5444ba None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:50.263223 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:50.273459 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32340466-fa92-40d3-b0f2-0dc9febcba2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:50.274110 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32340466-fa92-40d3-b0f2-0dc9febcba2e None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:50.274386 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32340466-fa92-40d3-b0f2-0dc9febcba2e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:50.274660 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32340466-fa92-40d3-b0f2-0dc9febcba2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:50.286992 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:50.292593 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32340466-fa92-40d3-b0f2-0dc9febcba2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:50.296834 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32340466-fa92-40d3-b0f2-0dc9febcba2e None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-32340466-fa92-40d3-b0f2-0dc9febcba2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:50.322218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:50.323700 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:50.324576 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:50.324576 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:50.324576 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:50.324576 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 288/573] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:50.325332 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32340466-fa92-40d3-b0f2-0dc9febcba2e None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:50.419035 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897e496-dab8-455f-b45f-6de84a5444ba None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:50.472903 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bb90b-c781-484c-9058-1ed084d1a87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:50.473572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bb90b-c781-484c-9058-1ed084d1a87a None admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:50.473846 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bb90b-c781-484c-9058-1ed084d1a87a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:50.474119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bb90b-c781-484c-9058-1ed084d1a87a None admin] PATH_INFO: `/v3/projects/c6af527bb8974bc6915553d99df0901e/users/4fe450e040874be58ea27dd47c3ff7a4/roles/7b8b39bfefe4416cab4e766c2cdb6006` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:50.488645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32340466-fa92-40d3-b0f2-0dc9febcba2e None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:50.491034 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bb90b-c781-484c-9058-1ed084d1a87a None admin] RBAC: Authorizing `identity:create_grant(project_id=c6af527bb8974bc6915553d99df0901e, user_id=4fe450e040874be58ea27dd47c3ff7a4, role_id=7b8b39bfefe4416cab4e766c2cdb6006)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:50.492508 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bb90b-c781-484c-9058-1ed084d1a87a None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:50.527926 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c85ead-e5be-4577-8696-99515ad703e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:50.528568 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c85ead-e5be-4577-8696-99515ad703e8 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:50.528850 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c85ead-e5be-4577-8696-99515ad703e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:50.529120 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c85ead-e5be-4577-8696-99515ad703e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:50.541844 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c85ead-e5be-4577-8696-99515ad703e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:50.543340 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c85ead-e5be-4577-8696-99515ad703e8 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-74c85ead-e5be-4577-8696-99515ad703e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:50.558693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:50.560909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:50.562556 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:50.562556 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:50.562556 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:50.562556 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 289/574] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:50.562556 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c85ead-e5be-4577-8696-99515ad703e8 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:50.587490 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 286/575] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:50:50 2022] PUT /identity/v3/projects/c6af527bb8974bc6915553d99df0901e/users/4fe450e040874be58ea27dd47c3ff7a4/roles/7b8b39bfefe4416cab4e766c2cdb6006 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:50:50.590118 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd8426-711c-4aae-a498-cb4e89ff6e46 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:50.590586 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd8426-711c-4aae-a498-cb4e89ff6e46 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:50.591070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd8426-711c-4aae-a498-cb4e89ff6e46 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:50.592667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 287/576] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:50 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:50.593463 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd8426-711c-4aae-a498-cb4e89ff6e46 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:50.609503 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:50.710892 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:50.729275 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c85ead-e5be-4577-8696-99515ad703e8 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:50.750950 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd8426-711c-4aae-a498-cb4e89ff6e46 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:50.779251 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fe277-b86f-4f3f-b794-57f5a8a4cbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:50.779886 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fe277-b86f-4f3f-b794-57f5a8a4cbbd None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:50.780165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fe277-b86f-4f3f-b794-57f5a8a4cbbd None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:50.780436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fe277-b86f-4f3f-b794-57f5a8a4cbbd None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:50.781680 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fe277-b86f-4f3f-b794-57f5a8a4cbbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:50.782012 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fe277-b86f-4f3f-b794-57f5a8a4cbbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:50.784535 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fe277-b86f-4f3f-b794-57f5a8a4cbbd None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:50.826059 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 290/577] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:50.826059 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d2e9d-0632-4940-b9b1-c0a724ea6711 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:50.826059 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d2e9d-0632-4940-b9b1-c0a724ea6711 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:50.826059 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d2e9d-0632-4940-b9b1-c0a724ea6711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:50.836627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45ecb4-c68f-4a41-9854-858d7d58bc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:50.837510 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ecb4-c68f-4a41-9854-858d7d58bc57 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:50.846924 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ecb4-c68f-4a41-9854-858d7d58bc57 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:50.846924 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45ecb4-c68f-4a41-9854-858d7d58bc57 None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:50.846924 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45ecb4-c68f-4a41-9854-858d7d58bc57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:50.846924 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45ecb4-c68f-4a41-9854-858d7d58bc57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:50.846924 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45ecb4-c68f-4a41-9854-858d7d58bc57 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:50.855946 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-575d2e9d-0632-4940-b9b1-c0a724ea6711 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:50.857874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-575d2e9d-0632-4940-b9b1-c0a724ea6711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:50.867668 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 288/578] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:50.869360 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45ecb4-c68f-4a41-9854-858d7d58bc57 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:50.980839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 291/579] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:50.981968 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d2e9d-0632-4940-b9b1-c0a724ea6711 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:51.010548 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:51.095039 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d2e9d-0632-4940-b9b1-c0a724ea6711 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:51.100232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45ecb4-c68f-4a41-9854-858d7d58bc57 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:51.166846 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67284b2f-d9fa-4083-a75c-210f6ee11021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:51.166846 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67284b2f-d9fa-4083-a75c-210f6ee11021 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:51.166846 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67284b2f-d9fa-4083-a75c-210f6ee11021 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:51.166846 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67284b2f-d9fa-4083-a75c-210f6ee11021 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:51.174848 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301fdc7-b7f0-46fb-b738-9f5cd6564ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:51.174848 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301fdc7-b7f0-46fb-b738-9f5cd6564ee3 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:51.174848 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301fdc7-b7f0-46fb-b738-9f5cd6564ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:51.174848 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301fdc7-b7f0-46fb-b738-9f5cd6564ee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:51.186850 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67284b2f-d9fa-4083-a75c-210f6ee11021 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:51.186850 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67284b2f-d9fa-4083-a75c-210f6ee11021 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:51.193300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301fdc7-b7f0-46fb-b738-9f5cd6564ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:51.198846 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301fdc7-b7f0-46fb-b738-9f5cd6564ee3 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:51.202846 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:51.214860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-67284b2f-d9fa-4083-a75c-210f6ee11021 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:51.214860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:51.214860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:51.214860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:51.214860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:51.214860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:51.214860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:51.214860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:51.214860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:51.214860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:51.214860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:51.214860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:51.214860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:50:51.214860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:50:51.214860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:51.218484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:51.219502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:50:51.219502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:50:51.219502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:50:51.219502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:50:51.219502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:50:51.219502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:50:51.219502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:51.219502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:51.222851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-3301fdc7-b7f0-46fb-b738-9f5cd6564ee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:51.222851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:51.222851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:51.222851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:51.222851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:51.222851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:51.222851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:51.222851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:51.222851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:51.222851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:51.222851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:51.222851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:51.222851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:50:51.222851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:50:51.222851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:51.224996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:51.227278 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:50:51.227278 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:50:51.227278 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:50:51.227278 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:50:51.227278 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:50:51.227278 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:50:51.227278 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:51.227278 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:51.239161 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 292/580] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:51.239161 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67284b2f-d9fa-4083-a75c-210f6ee11021 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:51.239375 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 289/581] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:51.239375 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301fdc7-b7f0-46fb-b738-9f5cd6564ee3 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:51.400421 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:51.426066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67284b2f-d9fa-4083-a75c-210f6ee11021 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:51.429951 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301fdc7-b7f0-46fb-b738-9f5cd6564ee3 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:51.475359 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e53670-0f67-460f-8b0e-895961594c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:51.476104 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e53670-0f67-460f-8b0e-895961594c36 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:51.476440 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e53670-0f67-460f-8b0e-895961594c36 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:51.482642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e53670-0f67-460f-8b0e-895961594c36 None admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:51.482642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e53670-0f67-460f-8b0e-895961594c36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:51.482642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e53670-0f67-460f-8b0e-895961594c36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:51.482642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e53670-0f67-460f-8b0e-895961594c36 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:51.483042 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca28bc-146a-449b-abae-d78046937ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:51.483405 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca28bc-146a-449b-abae-d78046937ee9 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:51.483717 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca28bc-146a-449b-abae-d78046937ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:51.484010 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca28bc-146a-449b-abae-d78046937ee9 None admin] PATH_INFO: `/v3/projects` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:51.484814 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca28bc-146a-449b-abae-d78046937ee9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:51.485151 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca28bc-146a-449b-abae-d78046937ee9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:51.486734 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca28bc-146a-449b-abae-d78046937ee9 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:51.498951 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 293/582] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:50:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:51.498951 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e53670-0f67-460f-8b0e-895961594c36 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:51.511069 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 290/583] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:50:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:51.513897 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca28bc-146a-449b-abae-d78046937ee9 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:51.609220 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:51.678111 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca28bc-146a-449b-abae-d78046937ee9 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:51.684558 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e53670-0f67-460f-8b0e-895961594c36 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:51.725825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b7269-0010-422b-90c5-22cd838f04fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:51.726675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b7269-0010-422b-90c5-22cd838f04fa None admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:51.727109 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b7269-0010-422b-90c5-22cd838f04fa None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:51.727408 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b7269-0010-422b-90c5-22cd838f04fa None admin] PATH_INFO: `/v3/projects/c6af527bb8974bc6915553d99df0901e/users/9a64697b77c04100934d5bd91cb321ed/roles/7b8b39bfefe4416cab4e766c2cdb6006` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:51.735617 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad1186-14b3-49d5-a2db-d7e1307a45b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:51.736631 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad1186-14b3-49d5-a2db-d7e1307a45b5 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:51.737367 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad1186-14b3-49d5-a2db-d7e1307a45b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:51.737886 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad1186-14b3-49d5-a2db-d7e1307a45b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:51.751655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad1186-14b3-49d5-a2db-d7e1307a45b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:51.755467 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b7269-0010-422b-90c5-22cd838f04fa None admin] RBAC: Authorizing `identity:create_grant(project_id=c6af527bb8974bc6915553d99df0901e, user_id=9a64697b77c04100934d5bd91cb321ed, role_id=7b8b39bfefe4416cab4e766c2cdb6006)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-b3ad1186-14b3-49d5-a2db-d7e1307a45b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:51.757577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:51.758482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:51.759474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:51.759474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:51.759474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:51.759474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:51.759474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:51.759474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:51.759474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:51.759474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:51.759474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:51.759474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:51.759474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:51.759474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:51.760227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b7269-0010-422b-90c5-22cd838f04fa None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:51.762163 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 294/584] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:50:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:51.764773 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad1186-14b3-49d5-a2db-d7e1307a45b5 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:51.768225 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:51.878050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad1186-14b3-49d5-a2db-d7e1307a45b5 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:51.919115 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d0224-6662-4e90-88c3-3f1002a2852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:51.919814 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d0224-6662-4e90-88c3-3f1002a2852f None admin] REQUEST_METHOD: `PUT` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:51.920094 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d0224-6662-4e90-88c3-3f1002a2852f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:51.920376 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d0224-6662-4e90-88c3-3f1002a2852f None admin] PATH_INFO: `/v3/projects/c6af527bb8974bc6915553d99df0901e/users/8b2d08cc51074be0801fd5df03e3e7b2/roles/7b8b39bfefe4416cab4e766c2cdb6006` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:51.936443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d0224-6662-4e90-88c3-3f1002a2852f None admin] RBAC: Authorizing `identity:create_grant(project_id=c6af527bb8974bc6915553d99df0901e, user_id=8b2d08cc51074be0801fd5df03e3e7b2, role_id=7b8b39bfefe4416cab4e766c2cdb6006)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:51.937989 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d0224-6662-4e90-88c3-3f1002a2852f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:51.971490 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 291/585] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:50:51 2022] PUT /identity/v3/projects/c6af527bb8974bc6915553d99df0901e/users/9a64697b77c04100934d5bd91cb321ed/roles/7b8b39bfefe4416cab4e766c2cdb6006 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:50:51.971490 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b7269-0010-422b-90c5-22cd838f04fa None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:52.097565 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b7269-0010-422b-90c5-22cd838f04fa None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:52.108252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:52.135794 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44236af4-b014-4969-9b8a-165a89c2cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:52.136425 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44236af4-b014-4969-9b8a-165a89c2cc95 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:52.136706 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44236af4-b014-4969-9b8a-165a89c2cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:52.136982 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44236af4-b014-4969-9b8a-165a89c2cc95 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:52.137658 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44236af4-b014-4969-9b8a-165a89c2cc95 None admin] RBAC: Adding query filter params (name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:52.137961 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44236af4-b014-4969-9b8a-165a89c2cc95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:52.139456 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44236af4-b014-4969-9b8a-165a89c2cc95 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:52.153448 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 292/586] 10.222.0.121 () {56 vars in 1108 bytes} [Fri Aug 26 00:50:51 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:52.157679 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44236af4-b014-4969-9b8a-165a89c2cc95 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:52.167207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 295/587] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:50:51 2022] PUT /identity/v3/projects/c6af527bb8974bc6915553d99df0901e/users/8b2d08cc51074be0801fd5df03e3e7b2/roles/7b8b39bfefe4416cab4e766c2cdb6006 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:50:52.332898 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44236af4-b014-4969-9b8a-165a89c2cc95 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:52.381581 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e24a64-a2d2-468e-8b27-554260e0de12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:52.382448 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e24a64-a2d2-468e-8b27-554260e0de12 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:52.382908 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e24a64-a2d2-468e-8b27-554260e0de12 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:52.383365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e24a64-a2d2-468e-8b27-554260e0de12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:52.396282 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e24a64-a2d2-468e-8b27-554260e0de12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:52.397856 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e24a64-a2d2-468e-8b27-554260e0de12 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-d9e24a64-a2d2-468e-8b27-554260e0de12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:52.429645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:52.430871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:52.432482 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:52.432482 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:52.432482 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:52.432482 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 293/588] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:52.437622 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d0224-6662-4e90-88c3-3f1002a2852f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:52.534769 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:52.574088 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d0224-6662-4e90-88c3-3f1002a2852f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:52.616071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf7a06-08dc-4ebf-8f02-89d8a284e6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:52.616933 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf7a06-08dc-4ebf-8f02-89d8a284e6d5 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:52.617310 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf7a06-08dc-4ebf-8f02-89d8a284e6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:52.617678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf7a06-08dc-4ebf-8f02-89d8a284e6d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:52.618431 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf7a06-08dc-4ebf-8f02-89d8a284e6d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:52.619396 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf7a06-08dc-4ebf-8f02-89d8a284e6d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:52.620932 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf7a06-08dc-4ebf-8f02-89d8a284e6d5 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:52.638811 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 296/589] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:52.640779 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e24a64-a2d2-468e-8b27-554260e0de12 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:52.671351 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:52.790264 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e24a64-a2d2-468e-8b27-554260e0de12 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:52.832043 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1b214-e72a-4f39-8e2f-940bdf6649b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:52.832851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1b214-e72a-4f39-8e2f-940bdf6649b5 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:52.833232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1b214-e72a-4f39-8e2f-940bdf6649b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:52.833603 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1b214-e72a-4f39-8e2f-940bdf6649b5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:52.843292 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1b214-e72a-4f39-8e2f-940bdf6649b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:52.845014 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1b214-e72a-4f39-8e2f-940bdf6649b5 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-78c1b214-e72a-4f39-8e2f-940bdf6649b5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:50:52.857801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:52.859769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:52.862129 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:52.862129 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:52.862129 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:50:52.862129 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:50:52.862129 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:50:52.862129 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:50:52.862129 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:50:52.862129 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:50:52.862129 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:50:52.862129 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:52.862129 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 294/590] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:52.867090 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf7a06-08dc-4ebf-8f02-89d8a284e6d5 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:52.991156 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf7a06-08dc-4ebf-8f02-89d8a284e6d5 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:53.008608 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:53.029207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51354d3a-3fc0-4484-b912-f01608789a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:53.029919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51354d3a-3fc0-4484-b912-f01608789a25 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:53.030203 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51354d3a-3fc0-4484-b912-f01608789a25 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:53.030478 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51354d3a-3fc0-4484-b912-f01608789a25 None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:53.041295 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51354d3a-3fc0-4484-b912-f01608789a25 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:53.041295 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51354d3a-3fc0-4484-b912-f01608789a25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:53.041295 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51354d3a-3fc0-4484-b912-f01608789a25 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:53.046041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab86a6-6b52-489f-94d8-6179224b04be None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:53.046327 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab86a6-6b52-489f-94d8-6179224b04be None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:53.046600 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab86a6-6b52-489f-94d8-6179224b04be None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:53.048295 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 295/591] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:53.055916 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a97310-c953-473a-89ff-920c40b0ebd2 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:53.056817 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a97310-c953-473a-89ff-920c40b0ebd2 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:53.057158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a97310-c953-473a-89ff-920c40b0ebd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:53.060261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 297/592] 10.222.0.121 () {56 vars in 1142 bytes} [Fri Aug 26 00:50:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:53.066050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51354d3a-3fc0-4484-b912-f01608789a25 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:53.083538 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-32a97310-c953-473a-89ff-920c40b0ebd2 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:53.084758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-32a97310-c953-473a-89ff-920c40b0ebd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:53.163700 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 296/593] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:50:53.197790 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51354d3a-3fc0-4484-b912-f01608789a25 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:53.238273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecedc28-21d1-449b-907b-28c1b54b879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:53.238918 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecedc28-21d1-449b-907b-28c1b54b879c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:53.239207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecedc28-21d1-449b-907b-28c1b54b879c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:53.239484 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecedc28-21d1-449b-907b-28c1b54b879c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:53.282844 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:53.323729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecedc28-21d1-449b-907b-28c1b54b879c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:53.327038 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecedc28-21d1-449b-907b-28c1b54b879c None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:53.443307 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 298/594] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:53 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:53.446249 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a97310-c953-473a-89ff-920c40b0ebd2 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:53.463727 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:53.527587 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecedc28-21d1-449b-907b-28c1b54b879c None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:53.559316 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a97310-c953-473a-89ff-920c40b0ebd2 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:53.596105 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba76cf-9fdc-47a7-af04-4dcb9c2a6c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:53.596749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba76cf-9fdc-47a7-af04-4dcb9c2a6c53 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:53.597022 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba76cf-9fdc-47a7-af04-4dcb9c2a6c53 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:53.597308 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba76cf-9fdc-47a7-af04-4dcb9c2a6c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:53.610182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:53.611096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba76cf-9fdc-47a7-af04-4dcb9c2a6c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:53.613551 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba76cf-9fdc-47a7-af04-4dcb9c2a6c53 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-bcba76cf-9fdc-47a7-af04-4dcb9c2a6c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:53.633326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:53.634575 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:53.635496 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:53.635496 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:53.635496 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:53.635496 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 297/595] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:53.641268 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba76cf-9fdc-47a7-af04-4dcb9c2a6c53 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:53.653667 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecedc28-21d1-449b-907b-28c1b54b879c None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:53.712301 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357ae39-1ffa-4f67-963b-b57c6b0022e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:53.713619 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357ae39-1ffa-4f67-963b-b57c6b0022e2 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:53.714142 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357ae39-1ffa-4f67-963b-b57c6b0022e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:53.714509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357ae39-1ffa-4f67-963b-b57c6b0022e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:53.721413 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:53.730976 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357ae39-1ffa-4f67-963b-b57c6b0022e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-0357ae39-1ffa-4f67-963b-b57c6b0022e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:53.736293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:53.737436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:53.738509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:53.738509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:53.738509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:53.738509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:53.738509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:53.738509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:53.738509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:53.738509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:53.738509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:53.738509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:53.738509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:53.738509 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:53.741001 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 299/596] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:50:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:53.747961 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357ae39-1ffa-4f67-963b-b57c6b0022e2 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:53.787975 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba76cf-9fdc-47a7-af04-4dcb9c2a6c53 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:53.831219 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9fa29-e6a3-4951-83fe-b06237e256d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:53.831219 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9fa29-e6a3-4951-83fe-b06237e256d4 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:53.831219 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9fa29-e6a3-4951-83fe-b06237e256d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:53.831219 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9fa29-e6a3-4951-83fe-b06237e256d4 None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:53.831647 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9fa29-e6a3-4951-83fe-b06237e256d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:53.831647 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9fa29-e6a3-4951-83fe-b06237e256d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:53.831647 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9fa29-e6a3-4951-83fe-b06237e256d4 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:53.846102 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 298/597] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:53.852122 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9fa29-e6a3-4951-83fe-b06237e256d4 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:53.874741 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357ae39-1ffa-4f67-963b-b57c6b0022e2 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:53.914658 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:53.923957 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141be82-588d-4e95-9fa0-c534c159f7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:53.925273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141be82-588d-4e95-9fa0-c534c159f7c4 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:53.925711 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141be82-588d-4e95-9fa0-c534c159f7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:53.926564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141be82-588d-4e95-9fa0-c534c159f7c4 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:53.927776 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141be82-588d-4e95-9fa0-c534c159f7c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:53.928259 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141be82-588d-4e95-9fa0-c534c159f7c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:53.930758 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141be82-588d-4e95-9fa0-c534c159f7c4 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:53.943971 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 300/598] 10.222.0.121 () {56 vars in 1108 bytes} [Fri Aug 26 00:50:53 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:53.949139 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141be82-588d-4e95-9fa0-c534c159f7c4 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:53.994706 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9fa29-e6a3-4951-83fe-b06237e256d4 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:54.030707 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:54.054608 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afad36-b412-4176-a1e1-e8a9e035feb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:54.056596 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afad36-b412-4176-a1e1-e8a9e035feb0 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:54.057287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afad36-b412-4176-a1e1-e8a9e035feb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:54.057998 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afad36-b412-4176-a1e1-e8a9e035feb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:54.067700 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afad36-b412-4176-a1e1-e8a9e035feb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:54.082983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afad36-b412-4176-a1e1-e8a9e035feb0 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:54.082983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-16afad36-b412-4176-a1e1-e8a9e035feb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:54.082983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:54.082983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:54.082983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:54.082983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:54.082983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:54.082983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:54.082983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:54.082983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:54.082983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:54.082983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:54.082983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:54.082983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:54.083858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:54.084770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:54.084770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:54.084770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:50:54.084770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:50:54.084770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:50:54.084770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:50:54.084770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:50:54.084770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:50:54.084770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:54.084770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:54.088085 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 299/599] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:54.095061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141be82-588d-4e95-9fa0-c534c159f7c4 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:54.097293 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afad36-b412-4176-a1e1-e8a9e035feb0 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:54.144480 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c14c1f-d8bc-412f-b02e-af564a79f411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:54.145933 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c14c1f-d8bc-412f-b02e-af564a79f411 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:54.146609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c14c1f-d8bc-412f-b02e-af564a79f411 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:54.147208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c14c1f-d8bc-412f-b02e-af564a79f411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:54.162278 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c14c1f-d8bc-412f-b02e-af564a79f411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:54.164422 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c14c1f-d8bc-412f-b02e-af564a79f411 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-23c14c1f-d8bc-412f-b02e-af564a79f411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:54.187397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:54.189532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:54.190841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:54.190841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:54.190841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:54.199011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 301/600] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:50:54.204150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c14c1f-d8bc-412f-b02e-af564a79f411 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:54.223300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afad36-b412-4176-a1e1-e8a9e035feb0 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:54.264080 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfbfe07-2b21-4ff8-a90a-193e7c03df43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:54.265176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbfe07-2b21-4ff8-a90a-193e7c03df43 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:54.265699 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbfe07-2b21-4ff8-a90a-193e7c03df43 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:54.266277 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfbfe07-2b21-4ff8-a90a-193e7c03df43 None admin] PATH_INFO: `/v3/projects` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:54.267401 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfbfe07-2b21-4ff8-a90a-193e7c03df43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:54.268721 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfbfe07-2b21-4ff8-a90a-193e7c03df43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:54.271306 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfbfe07-2b21-4ff8-a90a-193e7c03df43 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:54.274587 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:54.291595 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 300/601] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:50:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:54.303514 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfbfe07-2b21-4ff8-a90a-193e7c03df43 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:54.354172 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c14c1f-d8bc-412f-b02e-af564a79f411 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:54.387717 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:54.394552 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98234d96-a46d-4278-81ed-e38a6df9de1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:54.397342 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98234d96-a46d-4278-81ed-e38a6df9de1d None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:54.397342 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98234d96-a46d-4278-81ed-e38a6df9de1d None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:54.397342 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98234d96-a46d-4278-81ed-e38a6df9de1d None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:54.397342 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98234d96-a46d-4278-81ed-e38a6df9de1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:54.397342 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98234d96-a46d-4278-81ed-e38a6df9de1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:54.398075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98234d96-a46d-4278-81ed-e38a6df9de1d None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:54.417469 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 302/602] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:54.421402 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98234d96-a46d-4278-81ed-e38a6df9de1d None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:54.460807 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfbfe07-2b21-4ff8-a90a-193e7c03df43 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:54.500370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150255f4-0483-4a47-9481-0c379296c8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:54.500983 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150255f4-0483-4a47-9481-0c379296c8db None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:54.501344 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150255f4-0483-4a47-9481-0c379296c8db None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:54.501738 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150255f4-0483-4a47-9481-0c379296c8db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:54.502468 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150255f4-0483-4a47-9481-0c379296c8db None admin] RBAC: Adding query filter params (role.id=7b8b39bfefe4416cab4e766c2cdb6006, scope.project.id=c6af527bb8974bc6915553d99df0901e, user.id=b48c6b8ef7284907bbfd5b48e2b58516) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:54.502777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150255f4-0483-4a47-9481-0c379296c8db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:54.504267 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150255f4-0483-4a47-9481-0c379296c8db None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:54.518865 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 301/603] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:50:54 2022] GET /identity/v3/role_assignments?user.id=b48c6b8ef7284907bbfd5b48e2b58516&scope.project.id=c6af527bb8974bc6915553d99df0901e&role.id=7b8b39bfefe4416cab4e766c2cdb6006 => generated 610 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:54.518865 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c193198-ec12-404d-8442-fd14450fcfd9 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:54.518865 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c193198-ec12-404d-8442-fd14450fcfd9 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:54.518865 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c193198-ec12-404d-8442-fd14450fcfd9 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:54.518865 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 302/604] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:54.525403 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14178c7a-1050-4c8e-8e9f-ae0d0b6a21dc None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:54.525887 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14178c7a-1050-4c8e-8e9f-ae0d0b6a21dc None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:54.526337 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14178c7a-1050-4c8e-8e9f-ae0d0b6a21dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:54.558876 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-14178c7a-1050-4c8e-8e9f-ae0d0b6a21dc None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:54.559842 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-14178c7a-1050-4c8e-8e9f-ae0d0b6a21dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:54.582407 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98234d96-a46d-4278-81ed-e38a6df9de1d None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:54.586145 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:54.627276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda07a8-0337-4de5-b533-d2fd5e25028b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:54.628305 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda07a8-0337-4de5-b533-d2fd5e25028b None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:54.629098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda07a8-0337-4de5-b533-d2fd5e25028b None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:54.630598 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda07a8-0337-4de5-b533-d2fd5e25028b None admin] PATH_INFO: `/v3/users/glance` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:54.639212 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda07a8-0337-4de5-b533-d2fd5e25028b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:54.640908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda07a8-0337-4de5-b533-d2fd5e25028b None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-dbda07a8-0337-4de5-b533-d2fd5e25028b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:50:54.654655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:54.656894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:54.663472 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:54.663472 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:54.663472 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:50:54.663472 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:50:54.663472 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:50:54.663472 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:50:54.663472 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:50:54.663472 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:50:54.663472 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:50:54.663472 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:54.663472 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 303/606] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:50:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:54.664111 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 303/606] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:54.664589 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82805282-09d7-4cd6-9fc1-affe5ff15f0d None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:54.664589 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82805282-09d7-4cd6-9fc1-affe5ff15f0d None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:54.664589 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82805282-09d7-4cd6-9fc1-affe5ff15f0d None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:54.666591 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 304/607] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:54 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:54.671003 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82805282-09d7-4cd6-9fc1-affe5ff15f0d None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:54.672160 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e022af-62ac-4299-999c-313638f28634 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:54.672930 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e022af-62ac-4299-999c-313638f28634 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:54.673603 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e022af-62ac-4299-999c-313638f28634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:54.711699 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-88e022af-62ac-4299-999c-313638f28634 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:54.714505 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-88e022af-62ac-4299-999c-313638f28634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:54.772426 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:54.824708 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 304/608] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:54.845892 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82805282-09d7-4cd6-9fc1-affe5ff15f0d None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:54.884152 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b2798-121e-4b0f-bdb5-1ab5035ba473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:54.884849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b2798-121e-4b0f-bdb5-1ab5035ba473 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:54.885234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b2798-121e-4b0f-bdb5-1ab5035ba473 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:54.885609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b2798-121e-4b0f-bdb5-1ab5035ba473 None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:54.886462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b2798-121e-4b0f-bdb5-1ab5035ba473 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:54.886908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b2798-121e-4b0f-bdb5-1ab5035ba473 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:54.888490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b2798-121e-4b0f-bdb5-1ab5035ba473 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:54.912352 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 305/609] 10.222.0.121 () {56 vars in 1142 bytes} [Fri Aug 26 00:50:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:54.918861 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e022af-62ac-4299-999c-313638f28634 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:55.054734 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e022af-62ac-4299-999c-313638f28634 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:55.059929 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b2798-121e-4b0f-bdb5-1ab5035ba473 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:55.094993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6a795-40f5-4c5e-8b7b-56324612a502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:55.095611 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6a795-40f5-4c5e-8b7b-56324612a502 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:55.095891 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6a795-40f5-4c5e-8b7b-56324612a502 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:55.096161 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6a795-40f5-4c5e-8b7b-56324612a502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:55.097522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:55.144697 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:55.199844 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6a795-40f5-4c5e-8b7b-56324612a502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:55.201217 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6a795-40f5-4c5e-8b7b-56324612a502 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:55.209777 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b2798-121e-4b0f-bdb5-1ab5035ba473 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:55.262096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4217a27-318d-4de7-bace-31e546cfd51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:55.262752 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217a27-318d-4de7-bace-31e546cfd51a None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:55.263067 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217a27-318d-4de7-bace-31e546cfd51a None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:55.263345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4217a27-318d-4de7-bace-31e546cfd51a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:55.276171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4217a27-318d-4de7-bace-31e546cfd51a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-b4217a27-318d-4de7-bace-31e546cfd51a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:55.281406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:55.282572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:55.284111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:55.284111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:55.284111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:55.284111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:55.284111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:55.284111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:55.284111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:55.284111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:55.284111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:55.284111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:55.284111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:55.284111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:55.284111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 306/610] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:50:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:55.284111 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4217a27-318d-4de7-bace-31e546cfd51a None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:55.340445 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 305/611] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:54 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:55.341626 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6a795-40f5-4c5e-8b7b-56324612a502 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:55.403074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:55.413150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:55.425861 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4217a27-318d-4de7-bace-31e546cfd51a None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:55.454042 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6a795-40f5-4c5e-8b7b-56324612a502 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:55.464379 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f8d30-2c83-46bb-847f-e839b855670e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:55.465131 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f8d30-2c83-46bb-847f-e839b855670e None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:55.465405 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f8d30-2c83-46bb-847f-e839b855670e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:55.465673 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f8d30-2c83-46bb-847f-e839b855670e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:55.485284 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f8d30-2c83-46bb-847f-e839b855670e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-689f8d30-2c83-46bb-847f-e839b855670e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:50:55.494935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:55.496891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:55.498792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:55.498792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:55.498792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:55.498792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:55.498792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:50:55.498792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:50:55.498792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:50:55.498792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:50:55.498792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:50:55.498792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:50:55.498792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:50:55.498792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:55.501395 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6d57b-2031-469f-90e3-cea8269ccd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:55.502347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6d57b-2031-469f-90e3-cea8269ccd71 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:55.502937 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6d57b-2031-469f-90e3-cea8269ccd71 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:55.503827 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 307/612] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:50:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:55.504079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6d57b-2031-469f-90e3-cea8269ccd71 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:55.504765 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6d57b-2031-469f-90e3-cea8269ccd71 None admin] RBAC: Adding query filter params (name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:55.505073 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6d57b-2031-469f-90e3-cea8269ccd71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:55.505238 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f8d30-2c83-46bb-847f-e839b855670e None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:55.506694 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6d57b-2031-469f-90e3-cea8269ccd71 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:55.522013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 306/613] 10.222.0.121 () {56 vars in 1108 bytes} [Fri Aug 26 00:50:55 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:55.522996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6d57b-2031-469f-90e3-cea8269ccd71 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:55.639040 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f8d30-2c83-46bb-847f-e839b855670e None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:55.640505 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6d57b-2031-469f-90e3-cea8269ccd71 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:55.672310 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:55.676105 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f5b93-d451-4375-94e8-0b4c73e7a93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:55.676735 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f5b93-d451-4375-94e8-0b4c73e7a93f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:55.677013 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f5b93-d451-4375-94e8-0b4c73e7a93f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:55.677289 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f5b93-d451-4375-94e8-0b4c73e7a93f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:55.678582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edf7f9-62a3-4a0a-85e9-8a2541efb3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:55.679714 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edf7f9-62a3-4a0a-85e9-8a2541efb3fc None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:55.680143 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edf7f9-62a3-4a0a-85e9-8a2541efb3fc None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:55.680713 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edf7f9-62a3-4a0a-85e9-8a2541efb3fc None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:55.684778 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edf7f9-62a3-4a0a-85e9-8a2541efb3fc None admin] RBAC: Adding query filter params (name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:55.684778 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edf7f9-62a3-4a0a-85e9-8a2541efb3fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:55.684778 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edf7f9-62a3-4a0a-85e9-8a2541efb3fc None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:55.690608 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f5b93-d451-4375-94e8-0b4c73e7a93f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:55.692312 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f5b93-d451-4375-94e8-0b4c73e7a93f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:55.696296 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:55.698962 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 307/614] 10.222.0.121 () {56 vars in 1108 bytes} [Fri Aug 26 00:50:55 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:55.699715 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edf7f9-62a3-4a0a-85e9-8a2541efb3fc None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-ad6f5b93-d451-4375-94e8-0b4c73e7a93f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:55.713064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:55.714277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:55.720652 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:55.720652 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:55.720652 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:55.720652 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 308/615] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:55.720652 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f5b93-d451-4375-94e8-0b4c73e7a93f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:55.849998 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edf7f9-62a3-4a0a-85e9-8a2541efb3fc None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:55.866084 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f5b93-d451-4375-94e8-0b4c73e7a93f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:55.893423 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61bba2-9696-44d8-9b0e-38ee0164e6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:55.894383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61bba2-9696-44d8-9b0e-38ee0164e6d1 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:55.894810 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61bba2-9696-44d8-9b0e-38ee0164e6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:55.895260 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61bba2-9696-44d8-9b0e-38ee0164e6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:55.906912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa38cc-765b-47b7-8254-24d9a60a90d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:55.907565 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa38cc-765b-47b7-8254-24d9a60a90d5 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:55.908025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa38cc-765b-47b7-8254-24d9a60a90d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:55.908318 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa38cc-765b-47b7-8254-24d9a60a90d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:55.909304 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61bba2-9696-44d8-9b0e-38ee0164e6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:55.911245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61bba2-9696-44d8-9b0e-38ee0164e6d1 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:55.922804 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa38cc-765b-47b7-8254-24d9a60a90d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:55.924314 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa38cc-765b-47b7-8254-24d9a60a90d5 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-fc61bba2-9696-44d8-9b0e-38ee0164e6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:55.931091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:55.933021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:55.934798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:55.934798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:55.934798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:55.936885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 308/616] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:55.937866 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61bba2-9696-44d8-9b0e-38ee0164e6d1 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-c0fa38cc-765b-47b7-8254-24d9a60a90d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:55.949642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:55.951793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:55.953786 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:55.953786 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:55.953786 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:55.956396 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 309/617] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:55.959409 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa38cc-765b-47b7-8254-24d9a60a90d5 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:56.009852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:56.041336 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:56.100028 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61bba2-9696-44d8-9b0e-38ee0164e6d1 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:56.130181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa38cc-765b-47b7-8254-24d9a60a90d5 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:56.166545 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68597ccd-bba7-41f2-a797-b724e5d988cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:56.167577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68597ccd-bba7-41f2-a797-b724e5d988cb None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:56.167719 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68597ccd-bba7-41f2-a797-b724e5d988cb None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:56.167904 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68597ccd-bba7-41f2-a797-b724e5d988cb None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:56.168570 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68597ccd-bba7-41f2-a797-b724e5d988cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:56.168877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68597ccd-bba7-41f2-a797-b724e5d988cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:56.170272 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68597ccd-bba7-41f2-a797-b724e5d988cb None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:56.188152 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 309/618] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:56.188152 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68597ccd-bba7-41f2-a797-b724e5d988cb None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:56.198476 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855abfd-d6c6-4b2c-be96-dc34b3b3ab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:56.199277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855abfd-d6c6-4b2c-be96-dc34b3b3ab1c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:56.199657 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855abfd-d6c6-4b2c-be96-dc34b3b3ab1c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:56.200031 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855abfd-d6c6-4b2c-be96-dc34b3b3ab1c None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:56.200824 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855abfd-d6c6-4b2c-be96-dc34b3b3ab1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:56.201383 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855abfd-d6c6-4b2c-be96-dc34b3b3ab1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:56.203118 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855abfd-d6c6-4b2c-be96-dc34b3b3ab1c None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:56.222121 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 310/619] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:56.223227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855abfd-d6c6-4b2c-be96-dc34b3b3ab1c None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:56.336235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68597ccd-bba7-41f2-a797-b724e5d988cb None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:56.341100 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:56.372265 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855abfd-d6c6-4b2c-be96-dc34b3b3ab1c None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:56.382962 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:56.395150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9dc49-3063-4a2a-8e30-5703a7a1891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:56.395765 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9dc49-3063-4a2a-8e30-5703a7a1891a None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:56.398194 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9dc49-3063-4a2a-8e30-5703a7a1891a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:56.398194 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9dc49-3063-4a2a-8e30-5703a7a1891a None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:56.398194 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9dc49-3063-4a2a-8e30-5703a7a1891a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:56.398194 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9dc49-3063-4a2a-8e30-5703a7a1891a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:56.398590 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9dc49-3063-4a2a-8e30-5703a7a1891a None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:56.412875 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 310/620] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:56.413987 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae8797-0648-48df-bc02-f5bf317bf7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:56.414587 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae8797-0648-48df-bc02-f5bf317bf7c0 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:56.415014 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae8797-0648-48df-bc02-f5bf317bf7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:56.415350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae8797-0648-48df-bc02-f5bf317bf7c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:56.416258 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9dc49-3063-4a2a-8e30-5703a7a1891a None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:56.424437 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae8797-0648-48df-bc02-f5bf317bf7c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:56.426585 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae8797-0648-48df-bc02-f5bf317bf7c0 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:56.439370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-ceae8797-0648-48df-bc02-f5bf317bf7c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:56.439370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:56.439370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:56.439370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:56.439370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:56.439370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:56.439370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:56.439370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:56.439370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:56.439370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:56.439370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:56.439370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:56.439370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:50:56.439370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:50:56.439370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:56.440489 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:56.441515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:50:56.441515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:50:56.441515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:50:56.441515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:50:56.441515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:50:56.441515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:50:56.441515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:56.441515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:56.441515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 311/621] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:56.446606 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae8797-0648-48df-bc02-f5bf317bf7c0 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:56.537511 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9dc49-3063-4a2a-8e30-5703a7a1891a None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:56.579706 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a53b6-94ee-438b-97bf-7f19121678fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:56.581004 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a53b6-94ee-438b-97bf-7f19121678fe None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:56.581295 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a53b6-94ee-438b-97bf-7f19121678fe None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:56.581814 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a53b6-94ee-438b-97bf-7f19121678fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:56.590852 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae8797-0648-48df-bc02-f5bf317bf7c0 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:56.591795 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a53b6-94ee-438b-97bf-7f19121678fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:56.595478 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a53b6-94ee-438b-97bf-7f19121678fe None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-439a53b6-94ee-438b-97bf-7f19121678fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:50:56.607560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:56.608800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:56.609954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:56.609954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:56.609954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:50:56.609954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:50:56.609954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:50:56.609954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:50:56.609954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:50:56.609954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:50:56.609954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:50:56.609954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:56.610769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 311/622] 10.222.0.121 () {56 vars in 1098 bytes} [Fri Aug 26 00:50:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:56.611710 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a53b6-94ee-438b-97bf-7f19121678fe None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:56.642627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:56.652377 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b0c8e-f81d-423d-a2c4-ac35572ca710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:56.667041 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0c8e-f81d-423d-a2c4-ac35572ca710 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:56.667041 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0c8e-f81d-423d-a2c4-ac35572ca710 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:56.667041 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0c8e-f81d-423d-a2c4-ac35572ca710 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:56.667041 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b0c8e-f81d-423d-a2c4-ac35572ca710 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:56.667041 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b0c8e-f81d-423d-a2c4-ac35572ca710 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-4f3b0c8e-f81d-423d-a2c4-ac35572ca710 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:50:56.676760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:56.677919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:56.679083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:56.679083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:56.679083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:50:56.679083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:50:56.679083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:50:56.679083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:50:56.679083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:50:56.679083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:50:56.679083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:50:56.679083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:56.679083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 312/623] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:50:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:56.683596 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b0c8e-f81d-423d-a2c4-ac35572ca710 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:56.716274 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:56.733719 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a53b6-94ee-438b-97bf-7f19121678fe None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:56.770367 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe6015-6039-4422-b030-0c233cc17476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:56.771039 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe6015-6039-4422-b030-0c233cc17476 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:56.771321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe6015-6039-4422-b030-0c233cc17476 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:56.771594 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe6015-6039-4422-b030-0c233cc17476 None admin] PATH_INFO: `/v3/projects` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:56.772317 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe6015-6039-4422-b030-0c233cc17476 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:56.772613 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe6015-6039-4422-b030-0c233cc17476 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:56.774106 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe6015-6039-4422-b030-0c233cc17476 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:56.789037 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 312/624] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:50:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:56.795098 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe6015-6039-4422-b030-0c233cc17476 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:56.815481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b0c8e-f81d-423d-a2c4-ac35572ca710 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:56.855580 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5af86e-d6c3-4d81-9764-b3d282919c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:56.856343 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5af86e-d6c3-4d81-9764-b3d282919c6f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:56.856730 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5af86e-d6c3-4d81-9764-b3d282919c6f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:56.857103 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5af86e-d6c3-4d81-9764-b3d282919c6f None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:56.858142 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5af86e-d6c3-4d81-9764-b3d282919c6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:56.858549 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5af86e-d6c3-4d81-9764-b3d282919c6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:56.860768 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5af86e-d6c3-4d81-9764-b3d282919c6f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:56.886257 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 313/625] 10.222.0.121 () {56 vars in 1138 bytes} [Fri Aug 26 00:50:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:56.887816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5af86e-d6c3-4d81-9764-b3d282919c6f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:56.912918 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:56.932635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe6015-6039-4422-b030-0c233cc17476 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:56.981140 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228ca63-37c9-469d-b0b8-88b467c676a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:56.981691 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228ca63-37c9-469d-b0b8-88b467c676a1 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:56.981970 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228ca63-37c9-469d-b0b8-88b467c676a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:56.982247 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228ca63-37c9-469d-b0b8-88b467c676a1 None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:56.983180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228ca63-37c9-469d-b0b8-88b467c676a1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:56.983494 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228ca63-37c9-469d-b0b8-88b467c676a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:56.984937 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228ca63-37c9-469d-b0b8-88b467c676a1 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:56.990721 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:57.003031 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 313/626] 10.222.0.121 () {56 vars in 1144 bytes} [Fri Aug 26 00:50:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:57.004502 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228ca63-37c9-469d-b0b8-88b467c676a1 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:57.008275 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5af86e-d6c3-4d81-9764-b3d282919c6f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:57.046512 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e718742-0a7e-451a-882c-94a86e6c91ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:57.047151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e718742-0a7e-451a-882c-94a86e6c91ff None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:57.047433 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e718742-0a7e-451a-882c-94a86e6c91ff None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:57.047706 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e718742-0a7e-451a-882c-94a86e6c91ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:57.048435 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e718742-0a7e-451a-882c-94a86e6c91ff None admin] RBAC: Adding query filter params (role.id=7b8b39bfefe4416cab4e766c2cdb6006, scope.project.id=c6af527bb8974bc6915553d99df0901e, user.id=4fe450e040874be58ea27dd47c3ff7a4) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:57.048741 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e718742-0a7e-451a-882c-94a86e6c91ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:57.050209 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e718742-0a7e-451a-882c-94a86e6c91ff None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:57.057005 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 314/627] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:50:56 2022] GET /identity/v3/role_assignments?user.id=4fe450e040874be58ea27dd47c3ff7a4&scope.project.id=c6af527bb8974bc6915553d99df0901e&role.id=7b8b39bfefe4416cab4e766c2cdb6006 => generated 610 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:57.058298 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc7c56-cf79-42d0-aa58-3d117446d10c None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:57.058600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc7c56-cf79-42d0-aa58-3d117446d10c None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:57.058919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc7c56-cf79-42d0-aa58-3d117446d10c None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:57.060352 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 315/628] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:57.060933 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc7c56-cf79-42d0-aa58-3d117446d10c None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:57.123223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228ca63-37c9-469d-b0b8-88b467c676a1 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:57.170839 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6859db-452d-483b-88b9-434fcb06d15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:57.171649 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6859db-452d-483b-88b9-434fcb06d15c None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:57.172066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6859db-452d-483b-88b9-434fcb06d15c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:57.172355 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6859db-452d-483b-88b9-434fcb06d15c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:57.186356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:57.217831 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc7c56-cf79-42d0-aa58-3d117446d10c None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:57.266934 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6859db-452d-483b-88b9-434fcb06d15c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:57.268848 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6859db-452d-483b-88b9-434fcb06d15c None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:57.270048 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd8fc0-d1fd-42a6-b027-4bb6539100c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:57.270698 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd8fc0-d1fd-42a6-b027-4bb6539100c2 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:57.271025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd8fc0-d1fd-42a6-b027-4bb6539100c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:57.271544 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd8fc0-d1fd-42a6-b027-4bb6539100c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:57.311078 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:57.369997 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd8fc0-d1fd-42a6-b027-4bb6539100c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:57.371643 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd8fc0-d1fd-42a6-b027-4bb6539100c2 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:57.412470 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 314/629] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:57.412470 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b3495-99d5-4e51-a78f-34055efb6629 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:57.412470 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b3495-99d5-4e51-a78f-34055efb6629 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:57.412470 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b3495-99d5-4e51-a78f-34055efb6629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:57.428679 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-b54b3495-99d5-4e51-a78f-34055efb6629 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:57.429877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-b54b3495-99d5-4e51-a78f-34055efb6629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:57.467953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:57.500282 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 316/630] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:50:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:50:57.500282 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd8fc0-d1fd-42a6-b027-4bb6539100c2 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:57.530944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 315/631] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:57.530944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b3495-99d5-4e51-a78f-34055efb6629 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:57.581323 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:57.642834 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b3495-99d5-4e51-a78f-34055efb6629 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:57.644923 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd8fc0-d1fd-42a6-b027-4bb6539100c2 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:57.681326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15191dbf-0abf-41e8-ba18-bd18113439ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:57.682064 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15191dbf-0abf-41e8-ba18-bd18113439ef None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:57.682413 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15191dbf-0abf-41e8-ba18-bd18113439ef None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:57.682764 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15191dbf-0abf-41e8-ba18-bd18113439ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:57.685907 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d66037-5902-43b6-9339-bbeba6c6e390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:57.687439 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d66037-5902-43b6-9339-bbeba6c6e390 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:57.687900 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d66037-5902-43b6-9339-bbeba6c6e390 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:57.688349 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d66037-5902-43b6-9339-bbeba6c6e390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:57.694731 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15191dbf-0abf-41e8-ba18-bd18113439ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:57.696380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15191dbf-0abf-41e8-ba18-bd18113439ef None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:57.701156 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d66037-5902-43b6-9339-bbeba6c6e390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:57.702856 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d66037-5902-43b6-9339-bbeba6c6e390 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-15191dbf-0abf-41e8-ba18-bd18113439ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:57.713084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:57.714174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:57.715073 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:57.715073 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:57.715073 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:57.715073 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 316/632] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:57.720750 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15191dbf-0abf-41e8-ba18-bd18113439ef None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-29d66037-5902-43b6-9339-bbeba6c6e390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:50:57.725083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:57.726144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:50:57.727188 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:50:57.727188 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:50:57.727188 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:57.727188 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 317/633] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:57.737432 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d66037-5902-43b6-9339-bbeba6c6e390 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:57.754479 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:57.839494 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15191dbf-0abf-41e8-ba18-bd18113439ef None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:57.853184 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:57.857408 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d66037-5902-43b6-9339-bbeba6c6e390 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:57.877031 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe494c-19d7-431e-a1e4-4c4db4feeb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:57.877644 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe494c-19d7-431e-a1e4-4c4db4feeb03 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:57.877925 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe494c-19d7-431e-a1e4-4c4db4feeb03 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:57.878199 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe494c-19d7-431e-a1e4-4c4db4feeb03 None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:57.878878 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe494c-19d7-431e-a1e4-4c4db4feeb03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:57.879186 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe494c-19d7-431e-a1e4-4c4db4feeb03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:57.881155 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe494c-19d7-431e-a1e4-4c4db4feeb03 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:57.898662 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 317/634] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:57.898662 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe494c-19d7-431e-a1e4-4c4db4feeb03 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:57.898962 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73c30d-2779-4cd3-987a-4c2b2d62e00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:57.898962 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73c30d-2779-4cd3-987a-4c2b2d62e00e None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:57.898962 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73c30d-2779-4cd3-987a-4c2b2d62e00e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:57.898962 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73c30d-2779-4cd3-987a-4c2b2d62e00e None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:57.899239 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73c30d-2779-4cd3-987a-4c2b2d62e00e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:57.899239 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73c30d-2779-4cd3-987a-4c2b2d62e00e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:57.899239 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73c30d-2779-4cd3-987a-4c2b2d62e00e None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:57.921216 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 318/635] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:50:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:50:57.921216 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73c30d-2779-4cd3-987a-4c2b2d62e00e None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:57.997561 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:58.023915 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe494c-19d7-431e-a1e4-4c4db4feeb03 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:58.047237 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73c30d-2779-4cd3-987a-4c2b2d62e00e None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:58.076050 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad201ca-a594-4f33-8a7e-cd53263fff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:58.076686 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad201ca-a594-4f33-8a7e-cd53263fff40 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:58.076962 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad201ca-a594-4f33-8a7e-cd53263fff40 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:58.077233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad201ca-a594-4f33-8a7e-cd53263fff40 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:58.077877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad201ca-a594-4f33-8a7e-cd53263fff40 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:58.079379 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad201ca-a594-4f33-8a7e-cd53263fff40 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:58.090485 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ee742-6615-4bd6-b2c4-be3a79e9a7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:58.091072 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ee742-6615-4bd6-b2c4-be3a79e9a7dc None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:58.091343 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ee742-6615-4bd6-b2c4-be3a79e9a7dc None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-3ad201ca-a594-4f33-8a7e-cd53263fff40 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:58.091429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:58.092630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:58.093969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:58.093969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:58.093969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:58.093969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:58.093969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:58.093969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:58.093969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:58.093969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:58.093969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:58.093969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:58.093969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:50:58.093969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:50:58.093969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:50:58.093969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:58.095971 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ee742-6615-4bd6-b2c4-be3a79e9a7dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:58.096118 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 318/636] 10.222.0.121 () {56 vars in 1134 bytes} [Fri Aug 26 00:50:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:58.096118 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad201ca-a594-4f33-8a7e-cd53263fff40 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:58.104899 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ee742-6615-4bd6-b2c4-be3a79e9a7dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:58.106381 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ee742-6615-4bd6-b2c4-be3a79e9a7dc None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:58.118908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-018ee742-6615-4bd6-b2c4-be3a79e9a7dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:58.118908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:58.118908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:58.118908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:58.118908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:58.118908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:58.118908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:58.118908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:58.118908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:58.118908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:58.118908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:58.118908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:58.118908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:50:58.118908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:50:58.118908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:58.120227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:58.121488 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:50:58.121488 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:50:58.121488 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:50:58.121488 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:50:58.121488 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:50:58.121488 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:50:58.121488 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:58.121488 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:50:58.125180 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 319/637] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:58.126150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ee742-6615-4bd6-b2c4-be3a79e9a7dc None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:58.150904 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:58.218340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad201ca-a594-4f33-8a7e-cd53263fff40 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:58.243652 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ee742-6615-4bd6-b2c4-be3a79e9a7dc None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:58.269340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0d4bc-61cd-4404-acdc-08b88348b3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:58.269940 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0d4bc-61cd-4404-acdc-08b88348b3fc None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:58.270224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0d4bc-61cd-4404-acdc-08b88348b3fc None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:58.270502 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0d4bc-61cd-4404-acdc-08b88348b3fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:58.280377 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0d4bc-61cd-4404-acdc-08b88348b3fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:58.281972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0d4bc-61cd-4404-acdc-08b88348b3fc None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:58.296911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-f1b0d4bc-61cd-4404-acdc-08b88348b3fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:58.296911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:50:58.296911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:50:58.296911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:50:58.296911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:50:58.296911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:50:58.296911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:50:58.296911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:50:58.296911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:50:58.296911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:50:58.296911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:50:58.296911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:50:58.296911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:50:58.296911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:50:58.296911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:50:58.298127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:50:58.299162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:50:58.299162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:50:58.299162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:50:58.299162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:50:58.299162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:50:58.299162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:50:58.299162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:50:58.299162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:50:58.299162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 319/638] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:50:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:50:58.299162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0d4bc-61cd-4404-acdc-08b88348b3fc None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:58.310788 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7cfe7-756d-48a4-9e68-5e13ae7a23c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:58.311412 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:58.311938 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7cfe7-756d-48a4-9e68-5e13ae7a23c8 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:58.312230 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7cfe7-756d-48a4-9e68-5e13ae7a23c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:58.312508 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7cfe7-756d-48a4-9e68-5e13ae7a23c8 None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:58.313460 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7cfe7-756d-48a4-9e68-5e13ae7a23c8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:58.313800 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7cfe7-756d-48a4-9e68-5e13ae7a23c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:58.315386 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7cfe7-756d-48a4-9e68-5e13ae7a23c8 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:58.320742 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 320/639] 10.222.0.121 () {56 vars in 1129 bytes} [Fri Aug 26 00:50:58 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:58.322098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7cfe7-756d-48a4-9e68-5e13ae7a23c8 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:58.416108 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:58.434454 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0d4bc-61cd-4404-acdc-08b88348b3fc None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:58.436291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7cfe7-756d-48a4-9e68-5e13ae7a23c8 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:58.480021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba309eef-bcb7-44d8-b893-e4ac3f180f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:58.480334 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba309eef-bcb7-44d8-b893-e4ac3f180f3a None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:58.480560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba309eef-bcb7-44d8-b893-e4ac3f180f3a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:58.480830 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba309eef-bcb7-44d8-b893-e4ac3f180f3a None admin] PATH_INFO: `/v3/projects` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:58.481523 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba309eef-bcb7-44d8-b893-e4ac3f180f3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:58.481828 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba309eef-bcb7-44d8-b893-e4ac3f180f3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:58.483082 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e00e5-c835-4cd1-b15d-5127383c99ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:58.483426 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba309eef-bcb7-44d8-b893-e4ac3f180f3a None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:58.484110 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e00e5-c835-4cd1-b15d-5127383c99ff None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:58.484557 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e00e5-c835-4cd1-b15d-5127383c99ff None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:58.484992 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e00e5-c835-4cd1-b15d-5127383c99ff None admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:58.485821 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e00e5-c835-4cd1-b15d-5127383c99ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:58.486277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e00e5-c835-4cd1-b15d-5127383c99ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:58.487733 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e00e5-c835-4cd1-b15d-5127383c99ff None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:58.498071 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 320/640] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:58.499046 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba309eef-bcb7-44d8-b893-e4ac3f180f3a None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:58.503981 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 321/641] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:58.507845 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e00e5-c835-4cd1-b15d-5127383c99ff None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:58.588525 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:58.631308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e00e5-c835-4cd1-b15d-5127383c99ff None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:58.635617 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba309eef-bcb7-44d8-b893-e4ac3f180f3a None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:58.674146 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa5b43-d271-468d-b636-3205dc3281b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:58.674683 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa5b43-d271-468d-b636-3205dc3281b0 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:58.675001 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa5b43-d271-468d-b636-3205dc3281b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:58.675280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa5b43-d271-468d-b636-3205dc3281b0 None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:58.675950 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa5b43-d271-468d-b636-3205dc3281b0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:58.676220 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ca85f-1530-4d87-a260-4f9d316a3b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:58.676375 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa5b43-d271-468d-b636-3205dc3281b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:58.676836 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ca85f-1530-4d87-a260-4f9d316a3b04 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:58.677100 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ca85f-1530-4d87-a260-4f9d316a3b04 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:58.677374 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ca85f-1530-4d87-a260-4f9d316a3b04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:58.677676 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa5b43-d271-468d-b636-3205dc3281b0 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:58.678167 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ca85f-1530-4d87-a260-4f9d316a3b04 None admin] RBAC: Adding query filter params (role.id=7b8b39bfefe4416cab4e766c2cdb6006, scope.project.id=c6af527bb8974bc6915553d99df0901e, user.id=8b2d08cc51074be0801fd5df03e3e7b2) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:58.678454 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ca85f-1530-4d87-a260-4f9d316a3b04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:58.679974 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ca85f-1530-4d87-a260-4f9d316a3b04 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:58.695565 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 321/642] 10.222.0.121 () {56 vars in 1129 bytes} [Fri Aug 26 00:50:58 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:58.695565 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa5b43-d271-468d-b636-3205dc3281b0 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:58.695846 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 322/643] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:50:58 2022] GET /identity/v3/role_assignments?user.id=8b2d08cc51074be0801fd5df03e3e7b2&scope.project.id=c6af527bb8974bc6915553d99df0901e&role.id=7b8b39bfefe4416cab4e766c2cdb6006 => generated 610 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:58.831218 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa5b43-d271-468d-b636-3205dc3281b0 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:58.869320 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:58.876972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10621e19-e997-4ed2-85ec-9916755555f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:58.880798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10621e19-e997-4ed2-85ec-9916755555f0 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:58.880798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10621e19-e997-4ed2-85ec-9916755555f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:58.880798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10621e19-e997-4ed2-85ec-9916755555f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:58.880798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10621e19-e997-4ed2-85ec-9916755555f0 None admin] RBAC: Adding query filter params (role.id=7b8b39bfefe4416cab4e766c2cdb6006, scope.project.id=c6af527bb8974bc6915553d99df0901e, user.id=9a64697b77c04100934d5bd91cb321ed) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:50:58.880798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10621e19-e997-4ed2-85ec-9916755555f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:58.881247 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10621e19-e997-4ed2-85ec-9916755555f0 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:58.888598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 322/644] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:50:58 2022] GET /identity/v3/role_assignments?user.id=9a64697b77c04100934d5bd91cb321ed&scope.project.id=c6af527bb8974bc6915553d99df0901e&role.id=7b8b39bfefe4416cab4e766c2cdb6006 => generated 610 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:50:59.451770 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde0383-8e21-4dc7-b1d1-519f5fd70518 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:59.452058 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde0383-8e21-4dc7-b1d1-519f5fd70518 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:59.452335 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde0383-8e21-4dc7-b1d1-519f5fd70518 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:59.453948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 323/645] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:50:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:50:59.460335 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d94f4-5a01-496b-a1be-821b1129f977 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:59.460630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d94f4-5a01-496b-a1be-821b1129f977 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:59.460904 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d94f4-5a01-496b-a1be-821b1129f977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:59.488228 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-b04d94f4-5a01-496b-a1be-821b1129f977 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:59.490086 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-b04d94f4-5a01-496b-a1be-821b1129f977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:59.587883 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 323/646] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:50:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:50:59.941820 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde0383-8e21-4dc7-b1d1-519f5fd70518 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:59.958381 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:00.105564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde0383-8e21-4dc7-b1d1-519f5fd70518 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:00.159155 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2eb66f-f829-46b0-9202-20d2770a46dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:00.160125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eb66f-f829-46b0-9202-20d2770a46dc None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:00.160608 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eb66f-f829-46b0-9202-20d2770a46dc None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:00.161046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eb66f-f829-46b0-9202-20d2770a46dc None admin] PATH_INFO: `/v3/services/image` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:00.161836 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2eb66f-f829-46b0-9202-20d2770a46dc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:00.163557 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2eb66f-f829-46b0-9202-20d2770a46dc None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-cd2eb66f-f829-46b0-9202-20d2770a46dc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:00.177101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:00.178406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:00.179382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:00.179382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:00.179382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:00.179382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:00.179382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:00.179382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:00.179382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:00.179382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:00.179382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:00.179382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:00.179382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:00.179382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:00.179382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:51:00.179382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:00.182059 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 324/647] 10.222.0.121 () {56 vars in 1110 bytes} [Fri Aug 26 00:50:59 2022] GET /identity/v3/services/image => generated 86 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:00.194350 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d94f4-5a01-496b-a1be-821b1129f977 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:00.357225 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d94f4-5a01-496b-a1be-821b1129f977 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:00.391649 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:00.402703 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d7b5c-28ca-4eb3-9db5-be2787a25c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:00.403363 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d7b5c-28ca-4eb3-9db5-be2787a25c24 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:00.403645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d7b5c-28ca-4eb3-9db5-be2787a25c24 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:00.403918 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d7b5c-28ca-4eb3-9db5-be2787a25c24 None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:00.404559 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d7b5c-28ca-4eb3-9db5-be2787a25c24 None admin] RBAC: Adding query filter params (name=image) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:00.404862 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d7b5c-28ca-4eb3-9db5-be2787a25c24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:00.406572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d7b5c-28ca-4eb3-9db5-be2787a25c24 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:00.411969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 324/648] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:51:00 2022] GET /identity/v3/services?name=image => generated 123 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:00.418610 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2eb66f-f829-46b0-9202-20d2770a46dc None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:00.551390 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:00.616436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2eb66f-f829-46b0-9202-20d2770a46dc None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:00.689206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440dc19-6b4f-4f42-8083-22543f49976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:00.690236 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440dc19-6b4f-4f42-8083-22543f49976e None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:00.690719 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440dc19-6b4f-4f42-8083-22543f49976e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:00.691247 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440dc19-6b4f-4f42-8083-22543f49976e None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:00.692399 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440dc19-6b4f-4f42-8083-22543f49976e None admin] RBAC: Adding query filter params (type=image) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:00.693175 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440dc19-6b4f-4f42-8083-22543f49976e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:00.695825 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440dc19-6b4f-4f42-8083-22543f49976e None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:00.707821 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 325/649] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:51:00 2022] GET /identity/v3/services?type=image => generated 123 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:51:01.591278 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb27d6-b7a5-43d4-817e-c5f77cea6b9e None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:01.591814 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb27d6-b7a5-43d4-817e-c5f77cea6b9e None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:01.591814 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb27d6-b7a5-43d4-817e-c5f77cea6b9e None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:01.593551 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 325/650] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:01.599541 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366fffc-89ac-4d68-88df-d9bc73341baa None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:01.600513 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366fffc-89ac-4d68-88df-d9bc73341baa None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:01.601185 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366fffc-89ac-4d68-88df-d9bc73341baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:01.624765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-f366fffc-89ac-4d68-88df-d9bc73341baa None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:01.626615 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-f366fffc-89ac-4d68-88df-d9bc73341baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:01.657563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b302e-eef3-41c9-a0e2-f3fe7478d031 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:01.658462 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b302e-eef3-41c9-a0e2-f3fe7478d031 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:01.659295 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b302e-eef3-41c9-a0e2-f3fe7478d031 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:01.662437 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 326/651] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:01 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:01.671487 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196f78d-d785-44a7-a460-dc65e85e8708 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:01.672198 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196f78d-d785-44a7-a460-dc65e85e8708 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:01.672720 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196f78d-d785-44a7-a460-dc65e85e8708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:01.699566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-d196f78d-d785-44a7-a460-dc65e85e8708 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:01.701267 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-d196f78d-d785-44a7-a460-dc65e85e8708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:01.717915 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 326/652] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:51:01.782698 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 327/653] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:51:01.853517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a97386-3843-4fe6-bc3b-d5491d88c773 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:01.854061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a97386-3843-4fe6-bc3b-d5491d88c773 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:01.854486 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a97386-3843-4fe6-bc3b-d5491d88c773 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:01.856408 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 327/654] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:01 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:01.862670 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b285dca-f065-4086-aaf2-9f478928edd2 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:01.863281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b285dca-f065-4086-aaf2-9f478928edd2 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:01.863711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b285dca-f065-4086-aaf2-9f478928edd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:01.883767 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-5b285dca-f065-4086-aaf2-9f478928edd2 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:01.885233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-5b285dca-f065-4086-aaf2-9f478928edd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:01.971465 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 328/655] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:51:02.098387 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a97386-3843-4fe6-bc3b-d5491d88c773 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:02.180311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b285dca-f065-4086-aaf2-9f478928edd2 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:02.217775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:02.263245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:02.272499 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a97386-3843-4fe6-bc3b-d5491d88c773 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:02.316227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc98e1-723f-42d7-a892-fb259b8f0ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:02.317900 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc98e1-723f-42d7-a892-fb259b8f0ad6 None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:02.318705 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc98e1-723f-42d7-a892-fb259b8f0ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:02.319238 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc98e1-723f-42d7-a892-fb259b8f0ad6 None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:02.320186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc98e1-723f-42d7-a892-fb259b8f0ad6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:02.321968 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc98e1-723f-42d7-a892-fb259b8f0ad6 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:02.322112 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b285dca-f065-4086-aaf2-9f478928edd2 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:02.369456 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16d83c-1164-42c5-8118-f1ea8c58d150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:02.370112 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16d83c-1164-42c5-8118-f1ea8c58d150 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:02.370373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16d83c-1164-42c5-8118-f1ea8c58d150 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:02.370768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16d83c-1164-42c5-8118-f1ea8c58d150 None admin] PATH_INFO: `/v3/services/network` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:02.371395 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16d83c-1164-42c5-8118-f1ea8c58d150 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:02.372950 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16d83c-1164-42c5-8118-f1ea8c58d150 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-1e16d83c-1164-42c5-8118-f1ea8c58d150 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:02.384854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:02.386013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:02.387393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:02.387393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:02.387393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:02.387393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:02.387393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:02.387393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:02.387393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:02.387393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:02.387393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:02.387393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:02.387393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:02.387393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:02.387393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:51:02.387393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:02.387393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 329/656] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:51:02 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:02.388331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16d83c-1164-42c5-8118-f1ea8c58d150 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:02.484039 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 328/657] 10.222.0.121 () {60 vars in 1146 bytes} [Fri Aug 26 00:51:02 2022] POST /identity/v3/services => generated 252 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:51:02.485070 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc98e1-723f-42d7-a892-fb259b8f0ad6 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:02.553453 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16d83c-1164-42c5-8118-f1ea8c58d150 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:02.576054 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:02.630049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd46fb-66bd-4afa-9631-e4c8e8aee161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:02.631205 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd46fb-66bd-4afa-9631-e4c8e8aee161 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:02.631662 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd46fb-66bd-4afa-9631-e4c8e8aee161 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:02.632070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd46fb-66bd-4afa-9631-e4c8e8aee161 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:02.655053 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd46fb-66bd-4afa-9631-e4c8e8aee161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-d7fd46fb-66bd-4afa-9631-e4c8e8aee161 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:51:02.664702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:02.666254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:02.667139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:02.667139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:02.667139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:02.667139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:02.667139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:51:02.667139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:51:02.667139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:51:02.667139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:51:02.667139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:51:02.667139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:51:02.667139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:51:02.667139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:02.668828 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 330/658] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:51:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:02.674140 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd46fb-66bd-4afa-9631-e4c8e8aee161 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:02.675569 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc98e1-723f-42d7-a892-fb259b8f0ad6 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:02.709921 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:02.722003 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e420d6a-f839-439b-a5a3-9095e6c25bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:02.722627 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e420d6a-f839-439b-a5a3-9095e6c25bef None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:02.722949 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e420d6a-f839-439b-a5a3-9095e6c25bef None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:02.723254 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e420d6a-f839-439b-a5a3-9095e6c25bef None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:02.724578 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e420d6a-f839-439b-a5a3-9095e6c25bef None admin] RBAC: Adding query filter params (name=network) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:02.724578 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e420d6a-f839-439b-a5a3-9095e6c25bef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:02.725570 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e420d6a-f839-439b-a5a3-9095e6c25bef None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:02.735218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 329/659] 10.222.0.121 () {56 vars in 1117 bytes} [Fri Aug 26 00:51:02 2022] GET /identity/v3/services?name=network => generated 125 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:02.741506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e420d6a-f839-439b-a5a3-9095e6c25bef None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:02.845090 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd46fb-66bd-4afa-9631-e4c8e8aee161 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:02.896830 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5b953-98da-4581-9fe7-7da10536eeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:02.897776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5b953-98da-4581-9fe7-7da10536eeb6 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:02.898075 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5b953-98da-4581-9fe7-7da10536eeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:02.898350 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5b953-98da-4581-9fe7-7da10536eeb6 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:02.899857 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5b953-98da-4581-9fe7-7da10536eeb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:02.900163 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5b953-98da-4581-9fe7-7da10536eeb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:02.901348 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e420d6a-f839-439b-a5a3-9095e6c25bef None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:02.901703 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5b953-98da-4581-9fe7-7da10536eeb6 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:02.913833 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 331/660] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:51:02 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:02.919907 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5b953-98da-4581-9fe7-7da10536eeb6 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:02.945742 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee12ec-3b3c-4943-a9d5-2fbbd075d654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:02.946435 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee12ec-3b3c-4943-a9d5-2fbbd075d654 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:02.946717 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee12ec-3b3c-4943-a9d5-2fbbd075d654 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:02.947048 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee12ec-3b3c-4943-a9d5-2fbbd075d654 None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:02.948499 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee12ec-3b3c-4943-a9d5-2fbbd075d654 None admin] RBAC: Adding query filter params (type=network) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:02.948816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee12ec-3b3c-4943-a9d5-2fbbd075d654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:02.950586 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee12ec-3b3c-4943-a9d5-2fbbd075d654 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:02.957992 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 330/661] 10.222.0.121 () {56 vars in 1117 bytes} [Fri Aug 26 00:51:02 2022] GET /identity/v3/services?type=network => generated 125 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:02.967825 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:03.081373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5b953-98da-4581-9fe7-7da10536eeb6 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:03.125280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6b0e7-d8e5-4b19-a29c-0da610fa54e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:03.125935 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6b0e7-d8e5-4b19-a29c-0da610fa54e8 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:03.126215 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6b0e7-d8e5-4b19-a29c-0da610fa54e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:03.126489 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6b0e7-d8e5-4b19-a29c-0da610fa54e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:03.141615 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6b0e7-d8e5-4b19-a29c-0da610fa54e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:03.143256 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6b0e7-d8e5-4b19-a29c-0da610fa54e8 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-4fc6b0e7-d8e5-4b19-a29c-0da610fa54e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:51:03.162016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:03.163869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:51:03.165632 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:51:03.165632 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:51:03.165632 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:03.166945 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 332/662] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:03.169704 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee12ec-3b3c-4943-a9d5-2fbbd075d654 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:03.239060 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:03.296158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee12ec-3b3c-4943-a9d5-2fbbd075d654 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:03.333120 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ad298-03da-4078-851b-60fda8470420 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:03.333861 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ad298-03da-4078-851b-60fda8470420 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:03.334354 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ad298-03da-4078-851b-60fda8470420 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:03.336519 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 333/663] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:03.344723 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa543ca5-f1e8-45b8-aa94-ae3977becec8 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:03.345037 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa543ca5-f1e8-45b8-aa94-ae3977becec8 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:03.345286 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa543ca5-f1e8-45b8-aa94-ae3977becec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:03.345604 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f8cd0-60b0-468d-9a30-e3f14d0e2dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:03.346626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f8cd0-60b0-468d-9a30-e3f14d0e2dbf None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:03.347198 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f8cd0-60b0-468d-9a30-e3f14d0e2dbf None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:03.347403 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f8cd0-60b0-468d-9a30-e3f14d0e2dbf None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:03.348072 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f8cd0-60b0-468d-9a30-e3f14d0e2dbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:03.348385 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f8cd0-60b0-468d-9a30-e3f14d0e2dbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:03.349822 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f8cd0-60b0-468d-9a30-e3f14d0e2dbf None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:03.374277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 331/664] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:51:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:03.375359 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-fa543ca5-f1e8-45b8-aa94-ae3977becec8 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:03.376533 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f8cd0-60b0-468d-9a30-e3f14d0e2dbf None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:03.376652 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-fa543ca5-f1e8-45b8-aa94-ae3977becec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:03.499312 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 334/665] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:03 2022] POST /identity/v3/auth/tokens => generated 904 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:51:03.517341 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f8cd0-60b0-468d-9a30-e3f14d0e2dbf None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:03.533989 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:03.555776 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9924ff-9b20-42d8-96fe-65b5041199b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:03.556812 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9924ff-9b20-42d8-96fe-65b5041199b0 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:03.557445 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9924ff-9b20-42d8-96fe-65b5041199b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:03.558006 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9924ff-9b20-42d8-96fe-65b5041199b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:03.566619 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9924ff-9b20-42d8-96fe-65b5041199b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:03.568836 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9924ff-9b20-42d8-96fe-65b5041199b0 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-2c9924ff-9b20-42d8-96fe-65b5041199b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:51:03.583874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:03.584912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:03.585833 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:03.585833 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:03.585833 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:51:03.585833 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:51:03.585833 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:51:03.585833 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:51:03.585833 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:51:03.585833 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:51:03.585833 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:51:03.585833 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:03.589756 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 332/666] 10.222.0.121 () {56 vars in 1098 bytes} [Fri Aug 26 00:51:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:03.596202 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa543ca5-f1e8-45b8-aa94-ae3977becec8 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:03.625069 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:03.722781 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa543ca5-f1e8-45b8-aa94-ae3977becec8 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:03.765712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04186f32-a9cf-4999-8c02-da40c71ee338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:03.766754 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04186f32-a9cf-4999-8c02-da40c71ee338 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:03.767314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04186f32-a9cf-4999-8c02-da40c71ee338 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:03.767800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04186f32-a9cf-4999-8c02-da40c71ee338 None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:03.768780 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04186f32-a9cf-4999-8c02-da40c71ee338 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:03.769299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04186f32-a9cf-4999-8c02-da40c71ee338 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:03.771037 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04186f32-a9cf-4999-8c02-da40c71ee338 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:03.797471 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 335/667] 10.222.0.121 () {56 vars in 1138 bytes} [Fri Aug 26 00:51:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:03.802754 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9924ff-9b20-42d8-96fe-65b5041199b0 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:03.849255 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04186f32-a9cf-4999-8c02-da40c71ee338 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:03.953218 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:03.973572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9924ff-9b20-42d8-96fe-65b5041199b0 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:03.989579 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04186f32-a9cf-4999-8c02-da40c71ee338 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:04.018983 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c18997-1de8-4b57-b460-5e98dbcc448f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:04.019624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c18997-1de8-4b57-b460-5e98dbcc448f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:04.019900 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c18997-1de8-4b57-b460-5e98dbcc448f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:04.020172 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c18997-1de8-4b57-b460-5e98dbcc448f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:04.040536 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd6172-5aa7-4343-b0e9-48aaa11aaef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:04.041532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd6172-5aa7-4343-b0e9-48aaa11aaef0 None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:04.042319 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd6172-5aa7-4343-b0e9-48aaa11aaef0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:04.042757 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd6172-5aa7-4343-b0e9-48aaa11aaef0 None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:04.044136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd6172-5aa7-4343-b0e9-48aaa11aaef0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:04.046119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd6172-5aa7-4343-b0e9-48aaa11aaef0 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:04.078054 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:04.116599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c18997-1de8-4b57-b460-5e98dbcc448f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:04.118067 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c18997-1de8-4b57-b460-5e98dbcc448f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:04.229747 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 336/668] 10.222.0.121 () {60 vars in 1146 bytes} [Fri Aug 26 00:51:03 2022] POST /identity/v3/services => generated 243 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:51:04.253743 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 333/669] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:51:03 2022] GET /identity/v3/auth/tokens => generated 904 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:51:04.260672 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd6172-5aa7-4343-b0e9-48aaa11aaef0 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:04.425950 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd6172-5aa7-4343-b0e9-48aaa11aaef0 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:04.459553 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:04.470179 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bca9f6-bb20-4354-8cf4-00675b264610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:04.472999 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bca9f6-bb20-4354-8cf4-00675b264610 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:04.472999 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bca9f6-bb20-4354-8cf4-00675b264610 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:04.472999 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bca9f6-bb20-4354-8cf4-00675b264610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:04.483905 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bca9f6-bb20-4354-8cf4-00675b264610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:04.486421 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bca9f6-bb20-4354-8cf4-00675b264610 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-02bca9f6-bb20-4354-8cf4-00675b264610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:51:04.508162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:04.513507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:51:04.515533 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:51:04.515533 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:51:04.515533 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:04.515533 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 337/670] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:04.515931 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c18997-1de8-4b57-b460-5e98dbcc448f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:04.609836 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:04.649348 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c18997-1de8-4b57-b460-5e98dbcc448f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:04.693222 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55199c3-e848-442d-b216-439f0dd9457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:04.694597 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55199c3-e848-442d-b216-439f0dd9457f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:04.695154 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55199c3-e848-442d-b216-439f0dd9457f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:04.695680 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55199c3-e848-442d-b216-439f0dd9457f None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:04.696978 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55199c3-e848-442d-b216-439f0dd9457f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:04.697711 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55199c3-e848-442d-b216-439f0dd9457f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:04.700510 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55199c3-e848-442d-b216-439f0dd9457f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:04.721333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 334/671] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:51:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:04.727812 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bca9f6-bb20-4354-8cf4-00675b264610 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:04.854361 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bca9f6-bb20-4354-8cf4-00675b264610 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:04.894135 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53acb0-78a7-48a4-b66a-123f7131128d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:04.894951 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53acb0-78a7-48a4-b66a-123f7131128d None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:04.895316 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53acb0-78a7-48a4-b66a-123f7131128d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:04.895624 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53acb0-78a7-48a4-b66a-123f7131128d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:04.904201 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53acb0-78a7-48a4-b66a-123f7131128d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:04.905706 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53acb0-78a7-48a4-b66a-123f7131128d None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:04.919280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-bf53acb0-78a7-48a4-b66a-123f7131128d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:51:04.919280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:04.919280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:04.919280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:04.919280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:04.919280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:04.919280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:04.919280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:04.919280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:04.919280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:04.919280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:04.919280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:04.919280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:51:04.919280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:51:04.919280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:04.920252 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:04.921157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:51:04.921157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:51:04.921157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:51:04.921157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:51:04.921157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:51:04.921157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:51:04.921157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:51:04.921157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:04.921862 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 338/672] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:51:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:04.929785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55199c3-e848-442d-b216-439f0dd9457f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:05.072186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55199c3-e848-442d-b216-439f0dd9457f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:05.135259 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b23ebd8-54f5-45a5-bcbc-076d6cdad45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:05.136777 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23ebd8-54f5-45a5-bcbc-076d6cdad45f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:05.137528 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23ebd8-54f5-45a5-bcbc-076d6cdad45f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:05.138291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b23ebd8-54f5-45a5-bcbc-076d6cdad45f None admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:05.139952 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23ebd8-54f5-45a5-bcbc-076d6cdad45f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:05.140748 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23ebd8-54f5-45a5-bcbc-076d6cdad45f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:05.143742 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b23ebd8-54f5-45a5-bcbc-076d6cdad45f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:05.147245 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:05.170117 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 335/673] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:51:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:05.175911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53acb0-78a7-48a4-b66a-123f7131128d None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:05.243378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:05.247343 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863ab47-1748-4bb0-aa27-689ad0443706 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:05.247965 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863ab47-1748-4bb0-aa27-689ad0443706 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:05.248447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863ab47-1748-4bb0-aa27-689ad0443706 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:05.250128 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 336/674] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:51:05.256291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02824-ffe5-4b73-adf3-71692f7d4a84 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:05.256738 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02824-ffe5-4b73-adf3-71692f7d4a84 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:05.257027 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02824-ffe5-4b73-adf3-71692f7d4a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:05.277058 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-2aa02824-ffe5-4b73-adf3-71692f7d4a84 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:05.278340 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-2aa02824-ffe5-4b73-adf3-71692f7d4a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:05.378146 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53acb0-78a7-48a4-b66a-123f7131128d None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:05.383215 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 337/675] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:05 2022] POST /identity/v3/auth/tokens => generated 1000 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:05.426277 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb0069-430a-46cf-9488-bf6ecf7d1806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:05.427501 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb0069-430a-46cf-9488-bf6ecf7d1806 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:05.427977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb0069-430a-46cf-9488-bf6ecf7d1806 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:05.428449 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb0069-430a-46cf-9488-bf6ecf7d1806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:05.429393 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb0069-430a-46cf-9488-bf6ecf7d1806 None admin] RBAC: Adding query filter params (role.id=e73a8fc0684c4f6083a71ea9a85c7298, scope.project.id=c6af527bb8974bc6915553d99df0901e, user.id=9a64697b77c04100934d5bd91cb321ed) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:05.429882 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb0069-430a-46cf-9488-bf6ecf7d1806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:05.433061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb0069-430a-46cf-9488-bf6ecf7d1806 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:05.440943 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 339/676] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:51:05 2022] GET /identity/v3/role_assignments?user.id=9a64697b77c04100934d5bd91cb321ed&scope.project.id=c6af527bb8974bc6915553d99df0901e&role.id=e73a8fc0684c4f6083a71ea9a85c7298 => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:05.569423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd204d0-f9c3-40ed-83ac-fae00b0dee0a None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:05.569694 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd204d0-f9c3-40ed-83ac-fae00b0dee0a None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:05.569981 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd204d0-f9c3-40ed-83ac-fae00b0dee0a None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:05.577077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 338/677] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:05 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:05.588662 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab9075-3a5a-4e32-be37-c7b657b173be None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:05.589635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab9075-3a5a-4e32-be37-c7b657b173be None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:05.590303 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab9075-3a5a-4e32-be37-c7b657b173be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:05.621122 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-7bab9075-3a5a-4e32-be37-c7b657b173be None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:05.623637 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-7bab9075-3a5a-4e32-be37-c7b657b173be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:05.728164 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 340/678] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:05 2022] POST /identity/v3/auth/tokens => generated 1000 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:05.765108 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd204d0-f9c3-40ed-83ac-fae00b0dee0a None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:05.901879 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd204d0-f9c3-40ed-83ac-fae00b0dee0a None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:05.935321 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:05.945308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b719ddc-8099-4461-846a-e303fbd5804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:05.946885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719ddc-8099-4461-846a-e303fbd5804a None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:05.952404 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719ddc-8099-4461-846a-e303fbd5804a None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:05.952404 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719ddc-8099-4461-846a-e303fbd5804a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:05.952404 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b719ddc-8099-4461-846a-e303fbd5804a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:05.952404 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b719ddc-8099-4461-846a-e303fbd5804a None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-5b719ddc-8099-4461-846a-e303fbd5804a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:05.960375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:05.961634 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:05.962481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:05.962481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:05.962481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:05.962481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:05.962481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:05.962481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:05.962481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:05.962481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:05.962481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:05.962481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:05.962481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:05.962481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:05.962481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:51:05.962481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:05.965146 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 339/679] 10.222.0.121 () {56 vars in 1134 bytes} [Fri Aug 26 00:51:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:05.972399 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab9075-3a5a-4e32-be37-c7b657b173be None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:06.013901 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:06.095445 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab9075-3a5a-4e32-be37-c7b657b173be None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:06.104105 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b719ddc-8099-4461-846a-e303fbd5804a None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:06.139038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43879b0c-7edc-4fb2-a4c1-0f6206e5739b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:06.140045 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43879b0c-7edc-4fb2-a4c1-0f6206e5739b None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:06.140527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43879b0c-7edc-4fb2-a4c1-0f6206e5739b None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:06.141076 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43879b0c-7edc-4fb2-a4c1-0f6206e5739b None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:06.142038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43879b0c-7edc-4fb2-a4c1-0f6206e5739b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:06.142542 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43879b0c-7edc-4fb2-a4c1-0f6206e5739b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:06.144300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43879b0c-7edc-4fb2-a4c1-0f6206e5739b None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:06.150406 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 341/680] 10.222.0.121 () {56 vars in 1129 bytes} [Fri Aug 26 00:51:05 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:06.156552 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43879b0c-7edc-4fb2-a4c1-0f6206e5739b None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:06.249021 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b719ddc-8099-4461-846a-e303fbd5804a None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:06.307402 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267a244-d614-4ed0-8d87-b06e7f4aa156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:06.307612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:06.308744 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267a244-d614-4ed0-8d87-b06e7f4aa156 None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:06.309250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267a244-d614-4ed0-8d87-b06e7f4aa156 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:06.309792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267a244-d614-4ed0-8d87-b06e7f4aa156 None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:06.311327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267a244-d614-4ed0-8d87-b06e7f4aa156 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:06.313388 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267a244-d614-4ed0-8d87-b06e7f4aa156 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:06.314996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43879b0c-7edc-4fb2-a4c1-0f6206e5739b None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:06.359907 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a457c-542a-4608-9f32-889eba33ff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:06.360535 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a457c-542a-4608-9f32-889eba33ff15 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:06.360815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a457c-542a-4608-9f32-889eba33ff15 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:06.361085 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a457c-542a-4608-9f32-889eba33ff15 None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:06.361881 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a457c-542a-4608-9f32-889eba33ff15 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:06.362183 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a457c-542a-4608-9f32-889eba33ff15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:06.363624 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a457c-542a-4608-9f32-889eba33ff15 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:06.370850 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 342/681] 10.222.0.121 () {56 vars in 1129 bytes} [Fri Aug 26 00:51:06 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:06.377203 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a457c-542a-4608-9f32-889eba33ff15 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:06.423925 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 340/682] 10.222.0.121 () {60 vars in 1146 bytes} [Fri Aug 26 00:51:06 2022] POST /identity/v3/services => generated 241 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:51:06.522203 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a457c-542a-4608-9f32-889eba33ff15 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:06.578258 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4c78a-c50c-4ff3-aacf-8f60c43a4174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:06.578986 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4c78a-c50c-4ff3-aacf-8f60c43a4174 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:06.579274 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4c78a-c50c-4ff3-aacf-8f60c43a4174 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:06.579549 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4c78a-c50c-4ff3-aacf-8f60c43a4174 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:06.580315 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4c78a-c50c-4ff3-aacf-8f60c43a4174 None admin] RBAC: Adding query filter params (interface=public, service_id=9daae58a14f7414388e53522e39af9b6, region_id=RegionOne) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:06.580626 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4c78a-c50c-4ff3-aacf-8f60c43a4174 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:06.582118 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4c78a-c50c-4ff3-aacf-8f60c43a4174 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:06.592954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 343/683] 10.222.0.121 () {56 vars in 1256 bytes} [Fri Aug 26 00:51:06 2022] GET /identity/v3/endpoints?service_id=9daae58a14f7414388e53522e39af9b6&interface=public®ion_id=RegionOne => generated 195 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:51:06.599181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267a244-d614-4ed0-8d87-b06e7f4aa156 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:06.666778 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:06.733681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267a244-d614-4ed0-8d87-b06e7f4aa156 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:06.780188 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba662cd0-8745-4b5c-af8a-2a644d017532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:06.781861 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba662cd0-8745-4b5c-af8a-2a644d017532 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:06.782697 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba662cd0-8745-4b5c-af8a-2a644d017532 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:06.783425 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba662cd0-8745-4b5c-af8a-2a644d017532 None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:06.784262 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba662cd0-8745-4b5c-af8a-2a644d017532 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:06.785880 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba662cd0-8745-4b5c-af8a-2a644d017532 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:06.793536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 341/684] 10.222.0.121 () {56 vars in 1092 bytes} [Fri Aug 26 00:51:06 2022] GET /identity/v3/services => generated 1007 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:51:07.182466 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d3121-48f2-4006-957f-9a4fcdd0ac7b None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:07.183525 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d3121-48f2-4006-957f-9a4fcdd0ac7b None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:07.183525 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d3121-48f2-4006-957f-9a4fcdd0ac7b None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:07.186380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 344/685] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:07 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:07.196368 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f44c6-28d1-4e3d-a57e-acaca69fafae None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:07.196892 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f44c6-28d1-4e3d-a57e-acaca69fafae None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:07.197279 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f44c6-28d1-4e3d-a57e-acaca69fafae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:07.226131 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-f73f44c6-28d1-4e3d-a57e-acaca69fafae None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:07.227970 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-f73f44c6-28d1-4e3d-a57e-acaca69fafae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:07.334951 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 342/686] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:07 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:07.696536 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d3121-48f2-4006-957f-9a4fcdd0ac7b None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:07.728128 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:07.827735 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d3121-48f2-4006-957f-9a4fcdd0ac7b None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:07.873762 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d9f86-d087-4f79-9e94-99baae48c418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:07.874406 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d9f86-d087-4f79-9e94-99baae48c418 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:07.874690 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d9f86-d087-4f79-9e94-99baae48c418 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:07.875014 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d9f86-d087-4f79-9e94-99baae48c418 None admin] PATH_INFO: `/v3/services/image` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:07.875822 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d9f86-d087-4f79-9e94-99baae48c418 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:07.877366 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d9f86-d087-4f79-9e94-99baae48c418 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-ef9d9f86-d087-4f79-9e94-99baae48c418 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:07.888347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:07.890107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:07.892677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:07.892677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:07.892677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:07.892677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:07.892677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:07.892677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:07.892677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:07.892677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:07.892677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:07.892677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:07.892677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:07.892677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:07.892677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:51:07.892677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:07.892677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 345/687] 10.222.0.121 () {56 vars in 1110 bytes} [Fri Aug 26 00:51:07 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:07.902325 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f44c6-28d1-4e3d-a57e-acaca69fafae None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:07.984453 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:08.068004 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f44c6-28d1-4e3d-a57e-acaca69fafae None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:08.113842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375f4f5-9a24-49a9-b7a7-f8b13de49d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:08.114476 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375f4f5-9a24-49a9-b7a7-f8b13de49d0d None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:08.114753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375f4f5-9a24-49a9-b7a7-f8b13de49d0d None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:08.115061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375f4f5-9a24-49a9-b7a7-f8b13de49d0d None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:08.115963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375f4f5-9a24-49a9-b7a7-f8b13de49d0d None admin] RBAC: Adding query filter params (name=image) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:08.116272 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375f4f5-9a24-49a9-b7a7-f8b13de49d0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:08.118300 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375f4f5-9a24-49a9-b7a7-f8b13de49d0d None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:08.125356 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 343/688] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:51:07 2022] GET /identity/v3/services?name=image => generated 123 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:08.135516 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d9f86-d087-4f79-9e94-99baae48c418 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:08.242505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041ddbe-4187-48ee-a490-42043a096db7 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:08.244189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041ddbe-4187-48ee-a490-42043a096db7 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:08.244869 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041ddbe-4187-48ee-a490-42043a096db7 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:08.247589 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 344/689] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:08 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:51:08.264180 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b72bd8-ba3e-42c2-88bb-eb94569901b9 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:08.265114 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b72bd8-ba3e-42c2-88bb-eb94569901b9 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:08.265799 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b72bd8-ba3e-42c2-88bb-eb94569901b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:08.307884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-25b72bd8-ba3e-42c2-88bb-eb94569901b9 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:08.309988 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-25b72bd8-ba3e-42c2-88bb-eb94569901b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:08.327757 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:08.360100 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d9f86-d087-4f79-9e94-99baae48c418 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:08.431014 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 345/690] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:08 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:08.437517 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7702764-8a0f-4d2c-b755-30bf7920cb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:08.438601 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7702764-8a0f-4d2c-b755-30bf7920cb47 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:08.439140 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7702764-8a0f-4d2c-b755-30bf7920cb47 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:08.439641 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7702764-8a0f-4d2c-b755-30bf7920cb47 None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:08.440805 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7702764-8a0f-4d2c-b755-30bf7920cb47 None admin] RBAC: Adding query filter params (type=image) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:08.441342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7702764-8a0f-4d2c-b755-30bf7920cb47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:08.444545 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7702764-8a0f-4d2c-b755-30bf7920cb47 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:08.463021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 346/691] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:51:08 2022] GET /identity/v3/services?type=image => generated 352 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:08.465684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b72bd8-ba3e-42c2-88bb-eb94569901b9 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:08.510874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:08.615577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b72bd8-ba3e-42c2-88bb-eb94569901b9 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:08.657304 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca55bd-efe0-472c-ae5b-a03e3299ab0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:08.658213 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca55bd-efe0-472c-ae5b-a03e3299ab0e None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:08.658632 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca55bd-efe0-472c-ae5b-a03e3299ab0e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:08.659053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca55bd-efe0-472c-ae5b-a03e3299ab0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:08.660192 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca55bd-efe0-472c-ae5b-a03e3299ab0e None admin] RBAC: Adding query filter params (interface=public, service_id=1e712a48cc474a7abbf5cad50f988255, region_id=RegionOne) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:08.660676 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca55bd-efe0-472c-ae5b-a03e3299ab0e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:08.662958 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca55bd-efe0-472c-ae5b-a03e3299ab0e None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:08.678265 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 346/692] 10.222.0.121 () {56 vars in 1256 bytes} [Fri Aug 26 00:51:08 2022] GET /identity/v3/endpoints?service_id=1e712a48cc474a7abbf5cad50f988255&interface=public®ion_id=RegionOne => generated 195 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:51:08.694649 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7702764-8a0f-4d2c-b755-30bf7920cb47 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:08.893915 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca55bd-efe0-472c-ae5b-a03e3299ab0e None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:08.907735 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7702764-8a0f-4d2c-b755-30bf7920cb47 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:08.977941 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd621e7-81f7-4c1e-bbfb-d6a5ce67498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:08.979239 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd621e7-81f7-4c1e-bbfb-d6a5ce67498c None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:08.980012 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd621e7-81f7-4c1e-bbfb-d6a5ce67498c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:08.980815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd621e7-81f7-4c1e-bbfb-d6a5ce67498c None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:08.982328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd621e7-81f7-4c1e-bbfb-d6a5ce67498c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:08.987293 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd621e7-81f7-4c1e-bbfb-d6a5ce67498c None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:08.999228 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 347/693] 10.222.0.121 () {56 vars in 1092 bytes} [Fri Aug 26 00:51:08 2022] GET /identity/v3/services => generated 1007 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:51:09.028574 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:09.032270 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca55bd-efe0-472c-ae5b-a03e3299ab0e None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:09.082285 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b9108-81bc-4bce-8c7e-3de529923936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:09.083819 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b9108-81bc-4bce-8c7e-3de529923936 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:09.084638 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b9108-81bc-4bce-8c7e-3de529923936 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:09.085644 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b9108-81bc-4bce-8c7e-3de529923936 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:09.100732 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b9108-81bc-4bce-8c7e-3de529923936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-aa8b9108-81bc-4bce-8c7e-3de529923936 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:51:09.105816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:09.107174 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:09.109248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:09.109248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:09.109248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:09.109248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:09.109248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:51:09.109248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:51:09.109248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:51:09.109248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:51:09.109248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:51:09.109248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:51:09.109248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:51:09.109248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:09.109248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 347/694] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:51:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:09.114085 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd621e7-81f7-4c1e-bbfb-d6a5ce67498c None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:09.136158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:09.225554 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a69d1-5ccf-428e-ba83-d305a5b6f9e4 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:09.225752 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a69d1-5ccf-428e-ba83-d305a5b6f9e4 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:09.226176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a69d1-5ccf-428e-ba83-d305a5b6f9e4 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:09.228928 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 348/695] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:09 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:09.237459 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aca7b-9a66-45a6-b2f5-1aa57999ee6f None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:09.238311 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aca7b-9a66-45a6-b2f5-1aa57999ee6f None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:09.238880 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aca7b-9a66-45a6-b2f5-1aa57999ee6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:09.264236 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd621e7-81f7-4c1e-bbfb-d6a5ce67498c None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:09.271254 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-ec2aca7b-9a66-45a6-b2f5-1aa57999ee6f None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:09.273161 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-ec2aca7b-9a66-45a6-b2f5-1aa57999ee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:09.316390 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5959409-8171-4b18-b2ad-592e2f0229d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:09.317697 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5959409-8171-4b18-b2ad-592e2f0229d6 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:09.318191 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5959409-8171-4b18-b2ad-592e2f0229d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:09.318640 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5959409-8171-4b18-b2ad-592e2f0229d6 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:09.320305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5959409-8171-4b18-b2ad-592e2f0229d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:09.320865 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5959409-8171-4b18-b2ad-592e2f0229d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:09.322736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5959409-8171-4b18-b2ad-592e2f0229d6 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:09.334550 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 348/696] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:51:09 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:09.340113 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5959409-8171-4b18-b2ad-592e2f0229d6 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:09.394018 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 349/697] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:09 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:51:09.418771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0fc5d-1ca1-4d7b-ad79-aa84f75ad306 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:09.419101 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0fc5d-1ca1-4d7b-ad79-aa84f75ad306 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:09.419389 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0fc5d-1ca1-4d7b-ad79-aa84f75ad306 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:09.421043 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 350/698] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:51:09.427183 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c52836-12a2-45b8-9d63-8f47a1a7e212 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:09.427477 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c52836-12a2-45b8-9d63-8f47a1a7e212 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:09.427777 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c52836-12a2-45b8-9d63-8f47a1a7e212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:09.452699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-a6c52836-12a2-45b8-9d63-8f47a1a7e212 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:09.454328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-a6c52836-12a2-45b8-9d63-8f47a1a7e212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:09.467457 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:09.506753 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5959409-8171-4b18-b2ad-592e2f0229d6 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:09.566556 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8814ec-498c-49b6-b205-61fb83ef01a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:09.567641 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8814ec-498c-49b6-b205-61fb83ef01a0 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:09.568162 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8814ec-498c-49b6-b205-61fb83ef01a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:09.568335 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8814ec-498c-49b6-b205-61fb83ef01a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:09.578790 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 351/699] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:09 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:09.584009 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8814ec-498c-49b6-b205-61fb83ef01a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:09.585684 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8814ec-498c-49b6-b205-61fb83ef01a0 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-5c8814ec-498c-49b6-b205-61fb83ef01a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:51:09.605336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:09.606752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:51:09.607879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:51:09.607879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:51:09.607879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:09.611154 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 349/700] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:51:09.614307 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c52836-12a2-45b8-9d63-8f47a1a7e212 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:09.657930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:09.766790 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c52836-12a2-45b8-9d63-8f47a1a7e212 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:09.808459 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd5e4e-7f9d-4c1d-83a9-927b5baec065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:09.809393 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd5e4e-7f9d-4c1d-83a9-927b5baec065 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:09.809859 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd5e4e-7f9d-4c1d-83a9-927b5baec065 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:09.810335 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd5e4e-7f9d-4c1d-83a9-927b5baec065 None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:09.811205 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd5e4e-7f9d-4c1d-83a9-927b5baec065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:09.811718 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd5e4e-7f9d-4c1d-83a9-927b5baec065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:09.813294 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd5e4e-7f9d-4c1d-83a9-927b5baec065 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:09.826621 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8814ec-498c-49b6-b205-61fb83ef01a0 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:09.828611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 352/701] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:51:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:09.834952 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd5e4e-7f9d-4c1d-83a9-927b5baec065 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:09.931738 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:09.939800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8814ec-498c-49b6-b205-61fb83ef01a0 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:09.955283 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd5e4e-7f9d-4c1d-83a9-927b5baec065 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:09.970126 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:09.978713 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4cc82-2e17-48fe-99e0-a1c3d8f3f069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:09.979462 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4cc82-2e17-48fe-99e0-a1c3d8f3f069 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:09.979803 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4cc82-2e17-48fe-99e0-a1c3d8f3f069 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:09.980143 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4cc82-2e17-48fe-99e0-a1c3d8f3f069 None admin] PATH_INFO: `/v3/services/network` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:09.980789 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4cc82-2e17-48fe-99e0-a1c3d8f3f069 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:09.982240 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4cc82-2e17-48fe-99e0-a1c3d8f3f069 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-25d4cc82-2e17-48fe-99e0-a1c3d8f3f069 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:09.991227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:09.992241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:09.993651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:09.993651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:09.993651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:09.993651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:09.993651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:09.993651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:09.993651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:09.993651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:09.993651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:09.993651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:09.993651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:09.993651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:09.993651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:51:09.993651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:09.997763 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 350/702] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:51:09 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:10.002339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4cc82-2e17-48fe-99e0-a1c3d8f3f069 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:10.002450 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7a89a-f9ad-4bdd-a165-b03c3c569f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:10.003214 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7a89a-f9ad-4bdd-a165-b03c3c569f84 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:10.003714 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7a89a-f9ad-4bdd-a165-b03c3c569f84 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:10.004189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7a89a-f9ad-4bdd-a165-b03c3c569f84 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:10.012789 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7a89a-f9ad-4bdd-a165-b03c3c569f84 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:10.014556 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7a89a-f9ad-4bdd-a165-b03c3c569f84 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-c2f7a89a-f9ad-4bdd-a165-b03c3c569f84 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:51:10.028207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:10.029231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:10.030201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:10.030201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:10.030201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:51:10.030201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:51:10.030201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:51:10.030201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:51:10.030201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:51:10.030201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:51:10.030201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:51:10.030201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:10.037770 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 353/703] 10.222.0.121 () {56 vars in 1098 bytes} [Fri Aug 26 00:51:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:51:10.038936 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7a89a-f9ad-4bdd-a165-b03c3c569f84 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:10.106112 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4cc82-2e17-48fe-99e0-a1c3d8f3f069 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:10.141681 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e7f7e-a294-441c-994b-64d173f3bdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:10.142291 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e7f7e-a294-441c-994b-64d173f3bdfb None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:10.142567 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e7f7e-a294-441c-994b-64d173f3bdfb None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:10.142854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e7f7e-a294-441c-994b-64d173f3bdfb None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:10.143503 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e7f7e-a294-441c-994b-64d173f3bdfb None admin] RBAC: Adding query filter params (name=network) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:10.143790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e7f7e-a294-441c-994b-64d173f3bdfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:10.145188 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e7f7e-a294-441c-994b-64d173f3bdfb None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:10.153128 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 351/704] 10.222.0.121 () {56 vars in 1117 bytes} [Fri Aug 26 00:51:09 2022] GET /identity/v3/services?name=network => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:10.153963 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e7f7e-a294-441c-994b-64d173f3bdfb None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:10.159578 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7a89a-f9ad-4bdd-a165-b03c3c569f84 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:10.200888 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc9110-5a1a-4530-a943-5bec1d9ee560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:10.201619 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc9110-5a1a-4530-a943-5bec1d9ee560 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:10.201905 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc9110-5a1a-4530-a943-5bec1d9ee560 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:10.202181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc9110-5a1a-4530-a943-5bec1d9ee560 None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:10.202961 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc9110-5a1a-4530-a943-5bec1d9ee560 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:10.203283 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc9110-5a1a-4530-a943-5bec1d9ee560 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:10.204746 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc9110-5a1a-4530-a943-5bec1d9ee560 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:10.215311 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:10.220803 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:10.225361 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 354/705] 10.222.0.121 () {56 vars in 1138 bytes} [Fri Aug 26 00:51:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:10.231546 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc9110-5a1a-4530-a943-5bec1d9ee560 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:10.272823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e7f7e-a294-441c-994b-64d173f3bdfb None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:10.319522 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90936e73-cdb0-4a47-8512-e398bd71099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:10.320175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90936e73-cdb0-4a47-8512-e398bd71099d None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:10.321468 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90936e73-cdb0-4a47-8512-e398bd71099d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:10.321468 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90936e73-cdb0-4a47-8512-e398bd71099d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:10.321468 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90936e73-cdb0-4a47-8512-e398bd71099d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:10.322838 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90936e73-cdb0-4a47-8512-e398bd71099d None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-90936e73-cdb0-4a47-8512-e398bd71099d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:10.332736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:10.334284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:10.335790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:10.335790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:10.335790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:10.335790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:10.335790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:10.335790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:10.335790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:10.335790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:10.335790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:10.335790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:10.335790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:10.335790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:10.335790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:51:10.335790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:10.340693 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 352/706] 10.222.0.121 () {56 vars in 1134 bytes} [Fri Aug 26 00:51:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:10.341686 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90936e73-cdb0-4a47-8512-e398bd71099d None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:10.363738 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc9110-5a1a-4530-a943-5bec1d9ee560 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:10.401917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51076e-3a29-48bc-b1df-ed9ddcf347af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:10.402480 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51076e-3a29-48bc-b1df-ed9ddcf347af None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:10.402771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51076e-3a29-48bc-b1df-ed9ddcf347af None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:10.403107 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51076e-3a29-48bc-b1df-ed9ddcf347af None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:10.403704 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51076e-3a29-48bc-b1df-ed9ddcf347af None admin] RBAC: Adding query filter params (type=network) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:10.404004 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51076e-3a29-48bc-b1df-ed9ddcf347af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:10.405392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51076e-3a29-48bc-b1df-ed9ddcf347af None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:10.415201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 355/707] 10.222.0.121 () {56 vars in 1117 bytes} [Fri Aug 26 00:51:10 2022] GET /identity/v3/services?type=network => generated 352 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:10.418214 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51076e-3a29-48bc-b1df-ed9ddcf347af None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:10.487304 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90936e73-cdb0-4a47-8512-e398bd71099d None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:10.511190 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:10.512681 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:10.529021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc828ad-eecb-4388-8b38-cc1f68402d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:10.529955 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc828ad-eecb-4388-8b38-cc1f68402d05 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:10.530236 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc828ad-eecb-4388-8b38-cc1f68402d05 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:10.530505 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc828ad-eecb-4388-8b38-cc1f68402d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:10.544197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc828ad-eecb-4388-8b38-cc1f68402d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:10.545847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc828ad-eecb-4388-8b38-cc1f68402d05 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:10.556353 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51076e-3a29-48bc-b1df-ed9ddcf347af None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-efc828ad-eecb-4388-8b38-cc1f68402d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:51:10.561370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:10.569311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:51:10.570487 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:51:10.570487 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:51:10.570487 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:10.570487 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 353/708] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:10.570487 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc828ad-eecb-4388-8b38-cc1f68402d05 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:10.604716 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b2bc5-46c6-494f-bc06-41979e420c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:10.605381 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b2bc5-46c6-494f-bc06-41979e420c27 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:10.605666 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b2bc5-46c6-494f-bc06-41979e420c27 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:10.605932 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b2bc5-46c6-494f-bc06-41979e420c27 None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:10.606580 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b2bc5-46c6-494f-bc06-41979e420c27 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:10.606917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b2bc5-46c6-494f-bc06-41979e420c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:10.621781 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b2bc5-46c6-494f-bc06-41979e420c27 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:10.621781 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 356/709] 10.222.0.121 () {56 vars in 1129 bytes} [Fri Aug 26 00:51:10 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:10.621781 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b2bc5-46c6-494f-bc06-41979e420c27 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:10.685756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc828ad-eecb-4388-8b38-cc1f68402d05 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:10.740833 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af33b59-e85d-43d9-8e34-ce9e848f0ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:10.741783 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af33b59-e85d-43d9-8e34-ce9e848f0ae0 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:10.742212 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af33b59-e85d-43d9-8e34-ce9e848f0ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:10.742631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af33b59-e85d-43d9-8e34-ce9e848f0ae0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:10.743509 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af33b59-e85d-43d9-8e34-ce9e848f0ae0 None admin] RBAC: Adding query filter params (interface=public, service_id=c8134933efa24a87ba9bf390d3a2ce03, region_id=RegionOne) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:10.743950 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b2bc5-46c6-494f-bc06-41979e420c27 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:10.744119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af33b59-e85d-43d9-8e34-ce9e848f0ae0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:10.745766 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af33b59-e85d-43d9-8e34-ce9e848f0ae0 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:10.751961 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 354/710] 10.222.0.121 () {56 vars in 1256 bytes} [Fri Aug 26 00:51:10 2022] GET /identity/v3/endpoints?service_id=c8134933efa24a87ba9bf390d3a2ce03&interface=public®ion_id=RegionOne => generated 195 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:10.753065 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af33b59-e85d-43d9-8e34-ce9e848f0ae0 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:10.783433 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:10.795415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:10.796810 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b02e9-dfda-4137-803b-7feeb29932bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:10.797660 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b02e9-dfda-4137-803b-7feeb29932bb None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:10.797996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b02e9-dfda-4137-803b-7feeb29932bb None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:10.798317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b02e9-dfda-4137-803b-7feeb29932bb None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:10.799072 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b02e9-dfda-4137-803b-7feeb29932bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:10.799466 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b02e9-dfda-4137-803b-7feeb29932bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:10.800896 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b02e9-dfda-4137-803b-7feeb29932bb None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:10.813213 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 357/711] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:51:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:10.813565 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b02e9-dfda-4137-803b-7feeb29932bb None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:10.893846 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af33b59-e85d-43d9-8e34-ce9e848f0ae0 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:10.932085 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d1b1a-4919-41f7-9282-7aaf0f63b986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:10.932699 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d1b1a-4919-41f7-9282-7aaf0f63b986 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:10.932979 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d1b1a-4919-41f7-9282-7aaf0f63b986 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:10.933250 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d1b1a-4919-41f7-9282-7aaf0f63b986 None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:10.933879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d1b1a-4919-41f7-9282-7aaf0f63b986 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:10.934176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d1b1a-4919-41f7-9282-7aaf0f63b986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:10.935591 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d1b1a-4919-41f7-9282-7aaf0f63b986 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:10.940501 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 355/712] 10.222.0.121 () {56 vars in 1129 bytes} [Fri Aug 26 00:51:10 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:10.941290 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d1b1a-4919-41f7-9282-7aaf0f63b986 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:10.943674 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b02e9-dfda-4137-803b-7feeb29932bb None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:10.994758 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8377b2-39a0-4e15-8288-0264b3c450f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:10.996087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8377b2-39a0-4e15-8288-0264b3c450f9 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:10.996732 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8377b2-39a0-4e15-8288-0264b3c450f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:10.997385 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8377b2-39a0-4e15-8288-0264b3c450f9 None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:10.998300 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8377b2-39a0-4e15-8288-0264b3c450f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:11.000593 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8377b2-39a0-4e15-8288-0264b3c450f9 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:11.019041 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 358/713] 10.222.0.121 () {56 vars in 1092 bytes} [Fri Aug 26 00:51:10 2022] GET /identity/v3/services => generated 1007 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:51:11.020027 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8377b2-39a0-4e15-8288-0264b3c450f9 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:11.068837 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:11.073061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d1b1a-4919-41f7-9282-7aaf0f63b986 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:11.101974 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:11.131214 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415720b-91f4-4608-9689-1155378be0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:11.132322 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415720b-91f4-4608-9689-1155378be0fe None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:11.132862 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415720b-91f4-4608-9689-1155378be0fe None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:11.133389 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415720b-91f4-4608-9689-1155378be0fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:11.144151 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415720b-91f4-4608-9689-1155378be0fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:11.145731 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415720b-91f4-4608-9689-1155378be0fe None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:11.161743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-d415720b-91f4-4608-9689-1155378be0fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:51:11.161743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:11.161743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:11.161743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:11.161743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:11.161743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:11.161743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:11.161743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:11.161743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:11.161743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:11.161743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:11.161743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:11.161743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:51:11.161743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:51:11.161743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:11.163339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:11.164915 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:51:11.164915 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:51:11.164915 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:51:11.164915 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:51:11.164915 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:51:11.164915 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:51:11.164915 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:51:11.164915 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:11.168701 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 356/714] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:11.174432 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415720b-91f4-4608-9689-1155378be0fe None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:11.178493 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8377b2-39a0-4e15-8288-0264b3c450f9 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:11.229666 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc55d45-6087-4a22-9493-361146557c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:11.230248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc55d45-6087-4a22-9493-361146557c78 None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:11.230528 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc55d45-6087-4a22-9493-361146557c78 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:11.230794 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc55d45-6087-4a22-9493-361146557c78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:11.231600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc55d45-6087-4a22-9493-361146557c78 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:11.232970 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc55d45-6087-4a22-9493-361146557c78 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:11.324092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 359/715] 10.222.0.121 () {60 vars in 1149 bytes} [Fri Aug 26 00:51:11 2022] POST /identity/v3/endpoints => generated 348 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:51:11.334806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415720b-91f4-4608-9689-1155378be0fe None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:11.390354 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0062cc7-19bc-428a-80bc-42da8e2ac20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:11.391172 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0062cc7-19bc-428a-80bc-42da8e2ac20c None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:11.391458 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0062cc7-19bc-428a-80bc-42da8e2ac20c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:11.391734 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0062cc7-19bc-428a-80bc-42da8e2ac20c None admin] PATH_INFO: `/v3/projects` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:11.392445 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0062cc7-19bc-428a-80bc-42da8e2ac20c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:11.392754 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0062cc7-19bc-428a-80bc-42da8e2ac20c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:11.394338 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0062cc7-19bc-428a-80bc-42da8e2ac20c None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:11.409988 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 357/716] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:51:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:51:11.416849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc55d45-6087-4a22-9493-361146557c78 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:11.554758 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc55d45-6087-4a22-9493-361146557c78 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:11.566149 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:11.600907 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d5578-0ba0-4173-a5d6-b555843092ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:11.601664 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d5578-0ba0-4173-a5d6-b555843092ab None admin] REQUEST_METHOD: `PUT` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:11.602483 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d5578-0ba0-4173-a5d6-b555843092ab None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:11.602764 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d5578-0ba0-4173-a5d6-b555843092ab None admin] PATH_INFO: `/v3/projects/c6af527bb8974bc6915553d99df0901e/users/9a64697b77c04100934d5bd91cb321ed/roles/e73a8fc0684c4f6083a71ea9a85c7298` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:11.605088 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d5578-0ba0-4173-a5d6-b555843092ab None admin] RBAC: Authorizing `identity:create_grant(project_id=c6af527bb8974bc6915553d99df0901e, user_id=9a64697b77c04100934d5bd91cb321ed, role_id=e73a8fc0684c4f6083a71ea9a85c7298)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:11.606631 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d5578-0ba0-4173-a5d6-b555843092ab None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:11.663601 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a0d65-41e6-4eed-8081-5460423dcfbc None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:11.664021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a0d65-41e6-4eed-8081-5460423dcfbc None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:11.665362 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a0d65-41e6-4eed-8081-5460423dcfbc None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:11.667666 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 358/717] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:11 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:11.673181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa14a9-4667-4535-ace8-240255a5f684 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:11.673517 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa14a9-4667-4535-ace8-240255a5f684 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:11.673795 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa14a9-4667-4535-ace8-240255a5f684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:11.696492 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-5caa14a9-4667-4535-ace8-240255a5f684 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:11.701958 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-5caa14a9-4667-4535-ace8-240255a5f684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:11.710084 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:11.729310 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 360/718] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:51:11 2022] PUT /identity/v3/projects/c6af527bb8974bc6915553d99df0901e/users/9a64697b77c04100934d5bd91cb321ed/roles/e73a8fc0684c4f6083a71ea9a85c7298 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:51:11.801875 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 359/719] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:11 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:12.333654 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d5578-0ba0-4173-a5d6-b555843092ab None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:12.463350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d5578-0ba0-4173-a5d6-b555843092ab None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:12.506062 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13a30d-8b69-45a8-b6c9-8d6f88fe2b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:12.507103 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13a30d-8b69-45a8-b6c9-8d6f88fe2b5c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:12.507594 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13a30d-8b69-45a8-b6c9-8d6f88fe2b5c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:12.508143 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13a30d-8b69-45a8-b6c9-8d6f88fe2b5c None admin] PATH_INFO: `/v3/services/image` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:12.508943 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13a30d-8b69-45a8-b6c9-8d6f88fe2b5c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:12.510551 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13a30d-8b69-45a8-b6c9-8d6f88fe2b5c None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-7a13a30d-8b69-45a8-b6c9-8d6f88fe2b5c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:12.520701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:12.521729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:12.522563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:12.522563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:12.522563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:12.522563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:12.522563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:12.522563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:12.522563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:12.522563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:12.522563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:12.522563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:12.522563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:12.522563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:12.522563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:51:12.522563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:12.524927 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 361/720] 10.222.0.121 () {56 vars in 1110 bytes} [Fri Aug 26 00:51:12 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:12.531439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa14a9-4667-4535-ace8-240255a5f684 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:12.681744 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa14a9-4667-4535-ace8-240255a5f684 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:12.736810 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908a0a4-aa86-4449-adf4-d1888a2de174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:12.737754 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908a0a4-aa86-4449-adf4-d1888a2de174 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:12.738217 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908a0a4-aa86-4449-adf4-d1888a2de174 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:12.738673 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908a0a4-aa86-4449-adf4-d1888a2de174 None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:12.739542 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908a0a4-aa86-4449-adf4-d1888a2de174 None admin] RBAC: Adding query filter params (name=image) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:12.740056 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908a0a4-aa86-4449-adf4-d1888a2de174 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:12.741738 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908a0a4-aa86-4449-adf4-d1888a2de174 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:12.748592 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 360/721] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:51:12 2022] GET /identity/v3/services?name=image => generated 123 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:51:12.756567 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13a30d-8b69-45a8-b6c9-8d6f88fe2b5c None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:12.803450 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:12.905085 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13a30d-8b69-45a8-b6c9-8d6f88fe2b5c None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:12.957572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75ae60-1e2a-434f-a351-aecfe9179fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:12.958496 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75ae60-1e2a-434f-a351-aecfe9179fcb None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:12.958939 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75ae60-1e2a-434f-a351-aecfe9179fcb None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:12.959340 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75ae60-1e2a-434f-a351-aecfe9179fcb None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:12.960277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75ae60-1e2a-434f-a351-aecfe9179fcb None admin] RBAC: Adding query filter params (type=image) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:12.960722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75ae60-1e2a-434f-a351-aecfe9179fcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:12.963419 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75ae60-1e2a-434f-a351-aecfe9179fcb None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:12.974037 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 362/722] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:51:12 2022] GET /identity/v3/services?type=image => generated 352 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:12.975406 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908a0a4-aa86-4449-adf4-d1888a2de174 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:12.989784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:13.114759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908a0a4-aa86-4449-adf4-d1888a2de174 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:13.171074 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2eec3b-9114-4ffc-a08d-49a201bda1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:13.171772 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eec3b-9114-4ffc-a08d-49a201bda1fe None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:13.172051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eec3b-9114-4ffc-a08d-49a201bda1fe None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:13.172323 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2eec3b-9114-4ffc-a08d-49a201bda1fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:13.172998 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2eec3b-9114-4ffc-a08d-49a201bda1fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:13.174387 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2eec3b-9114-4ffc-a08d-49a201bda1fe None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:13.267905 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 361/723] 10.222.0.121 () {60 vars in 1149 bytes} [Fri Aug 26 00:51:12 2022] POST /identity/v3/endpoints => generated 329 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:51:13.511663 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460d98d-a438-4f76-888c-32e1c1802167 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:13.512194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460d98d-a438-4f76-888c-32e1c1802167 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:13.512194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460d98d-a438-4f76-888c-32e1c1802167 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:13.513956 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 363/724] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:13.519712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba8abd-1d2f-4097-85ac-ea4c6ae8631d None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:13.519978 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba8abd-1d2f-4097-85ac-ea4c6ae8631d None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:13.520176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba8abd-1d2f-4097-85ac-ea4c6ae8631d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:13.547165 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-b5ba8abd-1d2f-4097-85ac-ea4c6ae8631d None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:13.549241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-b5ba8abd-1d2f-4097-85ac-ea4c6ae8631d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:13.637754 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:13.653662 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 362/725] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:13 2022] POST /identity/v3/auth/tokens => generated 1249 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:14.060721 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce28a92-b735-429c-9169-136ab387097d None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:14.061137 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce28a92-b735-429c-9169-136ab387097d None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:14.061330 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce28a92-b735-429c-9169-136ab387097d None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:14.063031 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 364/726] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:14.068898 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9006c1-343f-42a9-b53b-f7081cbbc0fd None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:14.069192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9006c1-343f-42a9-b53b-f7081cbbc0fd None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:14.069471 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9006c1-343f-42a9-b53b-f7081cbbc0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:14.089882 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-6a9006c1-343f-42a9-b53b-f7081cbbc0fd None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:14.095369 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-6a9006c1-343f-42a9-b53b-f7081cbbc0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:14.095493 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaabf47-b14e-4b2f-b104-a55abe9848c8 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:14.095493 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaabf47-b14e-4b2f-b104-a55abe9848c8 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:14.095493 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaabf47-b14e-4b2f-b104-a55abe9848c8 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:14.095493 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 365/727] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:51:14.100182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca68a2-da56-4fcb-8d2e-0dd41e401d3e None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:14.100572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca68a2-da56-4fcb-8d2e-0dd41e401d3e None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:14.100927 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca68a2-da56-4fcb-8d2e-0dd41e401d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:14.120159 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-f1ca68a2-da56-4fcb-8d2e-0dd41e401d3e None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:14.121877 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-f1ca68a2-da56-4fcb-8d2e-0dd41e401d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:14.166871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 363/728] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:14 2022] POST /identity/v3/auth/tokens => generated 1249 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:14.167761 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9006c1-343f-42a9-b53b-f7081cbbc0fd None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:14.211378 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 366/729] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:14 2022] POST /identity/v3/auth/tokens => generated 1249 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:51:14.278991 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9006c1-343f-42a9-b53b-f7081cbbc0fd None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:14.303564 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:14.315479 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734d434-209c-49e9-842f-6a04f9ee120d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:14.316124 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734d434-209c-49e9-842f-6a04f9ee120d None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:14.316402 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734d434-209c-49e9-842f-6a04f9ee120d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:14.316672 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734d434-209c-49e9-842f-6a04f9ee120d None admin] PATH_INFO: `/v3/services/network` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:14.317521 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734d434-209c-49e9-842f-6a04f9ee120d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:14.318949 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734d434-209c-49e9-842f-6a04f9ee120d None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-8734d434-209c-49e9-842f-6a04f9ee120d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:14.328356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:14.329407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:14.330224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:14.330224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:14.330224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:14.330224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:14.330224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:14.330224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:14.330224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:14.330224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:14.330224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:14.330224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:14.330224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:14.330224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:14.330224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:51:14.330224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:14.330224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 364/730] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:51:14 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:14.337905 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca68a2-da56-4fcb-8d2e-0dd41e401d3e None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:14.373457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:14.461900 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca68a2-da56-4fcb-8d2e-0dd41e401d3e None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:14.501351 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b6a12-def4-4b07-8ded-26fd614ee7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:14.502330 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b6a12-def4-4b07-8ded-26fd614ee7e8 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:14.502809 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b6a12-def4-4b07-8ded-26fd614ee7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:14.503306 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b6a12-def4-4b07-8ded-26fd614ee7e8 None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:14.504148 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b6a12-def4-4b07-8ded-26fd614ee7e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:14.504668 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b6a12-def4-4b07-8ded-26fd614ee7e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:14.506266 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b6a12-def4-4b07-8ded-26fd614ee7e8 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:14.517754 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 367/731] 10.222.0.121 () {56 vars in 1117 bytes} [Fri Aug 26 00:51:14 2022] GET /identity/v3/services?name=network => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:14.518662 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734d434-209c-49e9-842f-6a04f9ee120d None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:14.538664 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b6a12-def4-4b07-8ded-26fd614ee7e8 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:14.646330 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:14.658344 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734d434-209c-49e9-842f-6a04f9ee120d None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:14.659418 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b6a12-def4-4b07-8ded-26fd614ee7e8 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:14.698051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae2ff0-e777-4b0f-a611-edc43113e15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:14.698277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41beace-9840-4272-82b9-462c5283ced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:14.698749 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41beace-9840-4272-82b9-462c5283ced0 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:14.698896 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae2ff0-e777-4b0f-a611-edc43113e15c None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:14.699174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae2ff0-e777-4b0f-a611-edc43113e15c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:14.699666 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae2ff0-e777-4b0f-a611-edc43113e15c None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:14.699846 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41beace-9840-4272-82b9-462c5283ced0 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:14.700324 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41beace-9840-4272-82b9-462c5283ced0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:14.700474 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae2ff0-e777-4b0f-a611-edc43113e15c None admin] RBAC: Adding query filter params (type=network) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:14.700762 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae2ff0-e777-4b0f-a611-edc43113e15c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:14.702242 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae2ff0-e777-4b0f-a611-edc43113e15c None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:14.707647 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 365/732] 10.222.0.121 () {56 vars in 1117 bytes} [Fri Aug 26 00:51:14 2022] GET /identity/v3/services?type=network => generated 352 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:14.708473 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae2ff0-e777-4b0f-a611-edc43113e15c None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:14.719487 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41beace-9840-4272-82b9-462c5283ced0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-b41beace-9840-4272-82b9-462c5283ced0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:51:14.724536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:14.725547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:14.726398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:14.726398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:14.726398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:14.726398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:14.726398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:51:14.726398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:51:14.726398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:51:14.726398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:51:14.726398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:51:14.726398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:51:14.726398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:51:14.726398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:14.733814 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 368/733] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:51:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:14.733814 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41beace-9840-4272-82b9-462c5283ced0 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:14.779497 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:14.836875 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae2ff0-e777-4b0f-a611-edc43113e15c None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:14.867707 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41beace-9840-4272-82b9-462c5283ced0 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:14.884644 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e4720-cbec-4ded-aa1c-da348623a8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:14.886074 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e4720-cbec-4ded-aa1c-da348623a8d1 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:14.886743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e4720-cbec-4ded-aa1c-da348623a8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:14.887185 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e4720-cbec-4ded-aa1c-da348623a8d1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:14.888025 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e4720-cbec-4ded-aa1c-da348623a8d1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:14.889909 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e4720-cbec-4ded-aa1c-da348623a8d1 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-d64e4720-cbec-4ded-aa1c-da348623a8d1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:14.900712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:14.901944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:14.903158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:14.903158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:14.903158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:14.903158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:14.903158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:14.903158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:14.903158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:14.903158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:14.903158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:14.903158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:14.903158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:14.903158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:14.903158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:51:14.903158 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:14.906733 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 366/734] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:51:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:14.907592 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e4720-cbec-4ded-aa1c-da348623a8d1 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:14.914168 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887bbdb-8e14-4c1d-ab98-ec90baed2b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:14.915353 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887bbdb-8e14-4c1d-ab98-ec90baed2b2d None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:14.915635 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887bbdb-8e14-4c1d-ab98-ec90baed2b2d None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:14.915916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887bbdb-8e14-4c1d-ab98-ec90baed2b2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:14.917025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887bbdb-8e14-4c1d-ab98-ec90baed2b2d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:14.919536 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887bbdb-8e14-4c1d-ab98-ec90baed2b2d None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:15.021089 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e4720-cbec-4ded-aa1c-da348623a8d1 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:15.031197 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 369/735] 10.222.0.121 () {60 vars in 1149 bytes} [Fri Aug 26 00:51:14 2022] POST /identity/v3/endpoints => generated 339 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:51:15.031197 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887bbdb-8e14-4c1d-ab98-ec90baed2b2d None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:15.035658 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:15.053323 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:15.099537 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85a617-72d7-4eab-aec6-b7dfe2922c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:15.100174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85a617-72d7-4eab-aec6-b7dfe2922c7a None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:15.100451 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85a617-72d7-4eab-aec6-b7dfe2922c7a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:15.100722 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85a617-72d7-4eab-aec6-b7dfe2922c7a None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:15.101474 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85a617-72d7-4eab-aec6-b7dfe2922c7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:15.102339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85a617-72d7-4eab-aec6-b7dfe2922c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:15.103911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85a617-72d7-4eab-aec6-b7dfe2922c7a None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:15.116495 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 367/736] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:51:14 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:15.124086 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85a617-72d7-4eab-aec6-b7dfe2922c7a None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:15.274114 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85a617-72d7-4eab-aec6-b7dfe2922c7a None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:15.306507 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887bbdb-8e14-4c1d-ab98-ec90baed2b2d None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:15.341292 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8e092-c66c-4ab1-b91f-79060ac674da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:15.342360 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8e092-c66c-4ab1-b91f-79060ac674da None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:15.342801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8e092-c66c-4ab1-b91f-79060ac674da None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:15.343372 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8e092-c66c-4ab1-b91f-79060ac674da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:15.351222 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914afae-7873-4916-8d3f-7a48590bb29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:15.352735 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914afae-7873-4916-8d3f-7a48590bb29f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:15.353231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914afae-7873-4916-8d3f-7a48590bb29f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:15.353709 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914afae-7873-4916-8d3f-7a48590bb29f None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:15.354586 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914afae-7873-4916-8d3f-7a48590bb29f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:15.354934 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914afae-7873-4916-8d3f-7a48590bb29f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:15.356317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914afae-7873-4916-8d3f-7a48590bb29f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:15.361670 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 370/737] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:51:15 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:15.364998 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8e092-c66c-4ab1-b91f-79060ac674da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:15.368106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914afae-7873-4916-8d3f-7a48590bb29f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:15.368279 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8e092-c66c-4ab1-b91f-79060ac674da None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-05b8e092-c66c-4ab1-b91f-79060ac674da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:51:15.395868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:15.397002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:51:15.397898 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:51:15.397898 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:51:15.397898 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:15.398691 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 368/738] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:15.403614 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8e092-c66c-4ab1-b91f-79060ac674da None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:15.432383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:15.467979 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:15.518342 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914afae-7873-4916-8d3f-7a48590bb29f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:15.529312 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8e092-c66c-4ab1-b91f-79060ac674da None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:15.564228 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48e02-220e-40a5-9230-9a92b1ad2e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:15.564934 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48e02-220e-40a5-9230-9a92b1ad2e7a None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:15.565254 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48e02-220e-40a5-9230-9a92b1ad2e7a None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:15.565534 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48e02-220e-40a5-9230-9a92b1ad2e7a None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:15.566439 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e48e02-220e-40a5-9230-9a92b1ad2e7a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:15.567320 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e48e02-220e-40a5-9230-9a92b1ad2e7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:15.568574 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e48e02-220e-40a5-9230-9a92b1ad2e7a None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:15.573804 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 371/739] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:51:15 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:51:15.581221 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b29ab-02fd-4fba-a4dc-e6d6e599aeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:15.583752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b29ab-02fd-4fba-a4dc-e6d6e599aeb7 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:15.583752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b29ab-02fd-4fba-a4dc-e6d6e599aeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:15.583752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b29ab-02fd-4fba-a4dc-e6d6e599aeb7 None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:15.584234 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b29ab-02fd-4fba-a4dc-e6d6e599aeb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:15.584379 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b29ab-02fd-4fba-a4dc-e6d6e599aeb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:15.587153 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b29ab-02fd-4fba-a4dc-e6d6e599aeb7 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:15.612810 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 369/740] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:51:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:51:15.614857 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48e02-220e-40a5-9230-9a92b1ad2e7a None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:15.777280 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48e02-220e-40a5-9230-9a92b1ad2e7a None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:15.814548 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:15.821223 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff0f85-25aa-4a87-80c7-46712a31bb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:15.821868 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff0f85-25aa-4a87-80c7-46712a31bb2f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:15.822150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff0f85-25aa-4a87-80c7-46712a31bb2f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:15.822432 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff0f85-25aa-4a87-80c7-46712a31bb2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:15.832242 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff0f85-25aa-4a87-80c7-46712a31bb2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:15.833880 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff0f85-25aa-4a87-80c7-46712a31bb2f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-83ff0f85-25aa-4a87-80c7-46712a31bb2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:51:15.846401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:15.847753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:15.848959 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:15.848959 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:15.848959 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:51:15.848959 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:51:15.848959 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:51:15.848959 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:51:15.848959 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:51:15.848959 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:51:15.848959 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:51:15.848959 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:15.848959 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 372/741] 10.222.0.121 () {56 vars in 1098 bytes} [Fri Aug 26 00:51:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:15.856620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b29ab-02fd-4fba-a4dc-e6d6e599aeb7 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:15.911733 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55f160-2789-4ed2-925b-0f4f33cd1254 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:15.912025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55f160-2789-4ed2-925b-0f4f33cd1254 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:15.912313 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55f160-2789-4ed2-925b-0f4f33cd1254 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:15.913762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 373/742] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:51:15.920006 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b0e0a-5da2-41bb-b81f-a074c516f7fa None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:15.920334 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b0e0a-5da2-41bb-b81f-a074c516f7fa None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:15.920532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b0e0a-5da2-41bb-b81f-a074c516f7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:15.940171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-d92b0e0a-5da2-41bb-b81f-a074c516f7fa None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:15.941391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-d92b0e0a-5da2-41bb-b81f-a074c516f7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:15.983044 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:16.007331 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b29ab-02fd-4fba-a4dc-e6d6e599aeb7 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:16.033942 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 374/743] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:15 2022] POST /identity/v3/auth/tokens => generated 1409 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:51:16.073380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7419b4-5c3c-4ffd-a48d-2765ff68692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:16.074469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7419b4-5c3c-4ffd-a48d-2765ff68692a None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:16.075132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7419b4-5c3c-4ffd-a48d-2765ff68692a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:16.075750 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7419b4-5c3c-4ffd-a48d-2765ff68692a None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:16.077260 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7419b4-5c3c-4ffd-a48d-2765ff68692a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:16.077920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7419b4-5c3c-4ffd-a48d-2765ff68692a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:16.080857 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7419b4-5c3c-4ffd-a48d-2765ff68692a None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:16.117052 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 370/744] 10.222.0.121 () {56 vars in 1138 bytes} [Fri Aug 26 00:51:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:16.122651 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b0e0a-5da2-41bb-b81f-a074c516f7fa None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:16.279245 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b0e0a-5da2-41bb-b81f-a074c516f7fa None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:16.313803 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:16.326672 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5495ce7-37b6-4541-ad09-dac121bea91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:16.327506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5495ce7-37b6-4541-ad09-dac121bea91d None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:16.332838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5495ce7-37b6-4541-ad09-dac121bea91d None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:16.332838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5495ce7-37b6-4541-ad09-dac121bea91d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:16.422313 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5495ce7-37b6-4541-ad09-dac121bea91d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:16.423898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5495ce7-37b6-4541-ad09-dac121bea91d None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:16.508251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7419b4-5c3c-4ffd-a48d-2765ff68692a None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:16.567095 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 375/745] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:51:16 2022] GET /identity/v3/auth/tokens => generated 1409 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:51:16.570702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5495ce7-37b6-4541-ad09-dac121bea91d None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:16.603386 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:16.645271 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7419b4-5c3c-4ffd-a48d-2765ff68692a None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:16.694118 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5495ce7-37b6-4541-ad09-dac121bea91d None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:16.697837 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c8e6d-d8ab-4b72-9098-d411be0125e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:16.698728 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c8e6d-d8ab-4b72-9098-d411be0125e1 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:16.699143 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c8e6d-d8ab-4b72-9098-d411be0125e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:16.699906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c8e6d-d8ab-4b72-9098-d411be0125e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:16.717758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:16.734444 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24667e-8204-41af-94fe-9e34c4622d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:16.735123 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24667e-8204-41af-94fe-9e34c4622d37 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:16.737607 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24667e-8204-41af-94fe-9e34c4622d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:16.737607 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24667e-8204-41af-94fe-9e34c4622d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:16.749300 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24667e-8204-41af-94fe-9e34c4622d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:16.750863 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24667e-8204-41af-94fe-9e34c4622d37 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-9c24667e-8204-41af-94fe-9e34c4622d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:51:16.768609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:16.772775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:51:16.773780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:51:16.773780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:51:16.773780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:16.773780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 376/746] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:51:16.775438 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24667e-8204-41af-94fe-9e34c4622d37 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:16.806856 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c8e6d-d8ab-4b72-9098-d411be0125e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:16.807804 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c8e6d-d8ab-4b72-9098-d411be0125e1 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:16.870969 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:16.912678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24667e-8204-41af-94fe-9e34c4622d37 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:16.944872 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 371/747] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:51:16 2022] GET /identity/v3/auth/tokens => generated 1409 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:51:16.950339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c8e6d-d8ab-4b72-9098-d411be0125e1 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:16.966874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e98bf-58ea-42e5-a2aa-3744f676be4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:16.966874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e98bf-58ea-42e5-a2aa-3744f676be4e None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:16.967467 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e98bf-58ea-42e5-a2aa-3744f676be4e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:16.967814 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e98bf-58ea-42e5-a2aa-3744f676be4e None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:16.968479 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e98bf-58ea-42e5-a2aa-3744f676be4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:16.968778 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e98bf-58ea-42e5-a2aa-3744f676be4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:16.970165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e98bf-58ea-42e5-a2aa-3744f676be4e None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:16.988674 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 377/748] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:51:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:51:16.989915 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e98bf-58ea-42e5-a2aa-3744f676be4e None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:17.001842 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:17.094535 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c8e6d-d8ab-4b72-9098-d411be0125e1 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:17.136189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e98bf-58ea-42e5-a2aa-3744f676be4e None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:17.137164 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef41bce-a3ba-4fcf-b2f8-52d1be45cd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:17.137792 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef41bce-a3ba-4fcf-b2f8-52d1be45cd4c None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:17.138068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef41bce-a3ba-4fcf-b2f8-52d1be45cd4c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:17.139111 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef41bce-a3ba-4fcf-b2f8-52d1be45cd4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:17.150865 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef41bce-a3ba-4fcf-b2f8-52d1be45cd4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:17.152332 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef41bce-a3ba-4fcf-b2f8-52d1be45cd4c None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-6ef41bce-a3ba-4fcf-b2f8-52d1be45cd4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:51:17.168776 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:17.169784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:51:17.170670 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:51:17.170670 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:51:17.170670 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:17.170670 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 372/749] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:51:17.176388 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef41bce-a3ba-4fcf-b2f8-52d1be45cd4c None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:17.183587 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b5a39-ff0b-4dbb-9057-dd8fdbaca92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:17.184231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b5a39-ff0b-4dbb-9057-dd8fdbaca92f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:17.184514 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b5a39-ff0b-4dbb-9057-dd8fdbaca92f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:17.184789 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b5a39-ff0b-4dbb-9057-dd8fdbaca92f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:17.187334 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:17.194005 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b5a39-ff0b-4dbb-9057-dd8fdbaca92f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:17.195644 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b5a39-ff0b-4dbb-9057-dd8fdbaca92f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:17.207053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-0b0b5a39-ff0b-4dbb-9057-dd8fdbaca92f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:51:17.207053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:17.207053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:17.207053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:17.207053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:17.207053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:17.207053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:17.207053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:17.207053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:17.207053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:17.207053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:17.207053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:17.207053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:51:17.207053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:51:17.207053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:17.208153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:17.209189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:51:17.209189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:51:17.209189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:51:17.209189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:51:17.209189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:51:17.209189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:51:17.209189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:51:17.209189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:17.209189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 378/750] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:51:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:17.214266 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b5a39-ff0b-4dbb-9057-dd8fdbaca92f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:17.355274 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b5a39-ff0b-4dbb-9057-dd8fdbaca92f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:17.400206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc46120-f6f9-49db-b8b5-0b2220328472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:17.400740 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc46120-f6f9-49db-b8b5-0b2220328472 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:17.401125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc46120-f6f9-49db-b8b5-0b2220328472 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:17.401779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc46120-f6f9-49db-b8b5-0b2220328472 None admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:17.402141 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc46120-f6f9-49db-b8b5-0b2220328472 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:17.402447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc46120-f6f9-49db-b8b5-0b2220328472 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:17.404175 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc46120-f6f9-49db-b8b5-0b2220328472 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:17.419791 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 379/751] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:51:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:51:17.425787 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc46120-f6f9-49db-b8b5-0b2220328472 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:17.442494 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:17.456417 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef41bce-a3ba-4fcf-b2f8-52d1be45cd4c None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:17.490649 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:17.510383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6d8f8-40c6-449d-ad0b-868da8a65a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:17.511281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6d8f8-40c6-449d-ad0b-868da8a65a9f None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:17.511821 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6d8f8-40c6-449d-ad0b-868da8a65a9f None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:17.512251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6d8f8-40c6-449d-ad0b-868da8a65a9f None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:17.513238 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6d8f8-40c6-449d-ad0b-868da8a65a9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:17.513689 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6d8f8-40c6-449d-ad0b-868da8a65a9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:17.515292 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6d8f8-40c6-449d-ad0b-868da8a65a9f None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:17.528313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 373/752] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:51:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:17.558724 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc46120-f6f9-49db-b8b5-0b2220328472 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:17.603943 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a513470-8423-48fc-b429-783e73e18147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:17.604657 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a513470-8423-48fc-b429-783e73e18147 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:17.604928 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a513470-8423-48fc-b429-783e73e18147 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:17.605108 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a513470-8423-48fc-b429-783e73e18147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:17.605839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a513470-8423-48fc-b429-783e73e18147 None admin] RBAC: Adding query filter params (role.id=e73a8fc0684c4f6083a71ea9a85c7298, scope.project.id=c6af527bb8974bc6915553d99df0901e, user.id=9a64697b77c04100934d5bd91cb321ed) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:17.606157 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a513470-8423-48fc-b429-783e73e18147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:17.607795 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a513470-8423-48fc-b429-783e73e18147 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:17.615387 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 380/753] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:51:17 2022] GET /identity/v3/role_assignments?user.id=9a64697b77c04100934d5bd91cb321ed&scope.project.id=c6af527bb8974bc6915553d99df0901e&role.id=e73a8fc0684c4f6083a71ea9a85c7298 => generated 610 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:51:18.002406 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730b18d-582a-4ab7-992d-d19f8c6c6f7b None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:18.002980 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730b18d-582a-4ab7-992d-d19f8c6c6f7b None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:18.002980 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730b18d-582a-4ab7-992d-d19f8c6c6f7b None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:18.004323 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 374/754] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:51:18.009913 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc285b95-f756-44c8-8991-5158e3e7737d None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:18.010264 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc285b95-f756-44c8-8991-5158e3e7737d None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:18.010602 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc285b95-f756-44c8-8991-5158e3e7737d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:18.028954 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-dc285b95-f756-44c8-8991-5158e3e7737d None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:18.030150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-dc285b95-f756-44c8-8991-5158e3e7737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:18.118089 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 381/755] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:18 2022] POST /identity/v3/auth/tokens => generated 1409 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:18.444862 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730b18d-582a-4ab7-992d-d19f8c6c6f7b None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:18.552433 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730b18d-582a-4ab7-992d-d19f8c6c6f7b None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:18.595494 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eeb01b-5271-4774-b37c-63c372da1340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:18.596099 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eeb01b-5271-4774-b37c-63c372da1340 None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:18.596370 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eeb01b-5271-4774-b37c-63c372da1340 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:18.596633 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eeb01b-5271-4774-b37c-63c372da1340 None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:18.597276 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eeb01b-5271-4774-b37c-63c372da1340 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:18.598653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eeb01b-5271-4774-b37c-63c372da1340 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:18.706231 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 375/756] 10.222.0.121 () {60 vars in 1146 bytes} [Fri Aug 26 00:51:18 2022] POST /identity/v3/services => generated 252 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:51:20.029596 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868275a8-e5ec-4faf-a5d7-301db64dcad1 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:20.030386 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868275a8-e5ec-4faf-a5d7-301db64dcad1 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:20.030386 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868275a8-e5ec-4faf-a5d7-301db64dcad1 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:20.031711 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 382/757] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:20.037340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecae70c-2382-49b8-9fe9-85985905f228 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:20.037840 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecae70c-2382-49b8-9fe9-85985905f228 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:20.038066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecae70c-2382-49b8-9fe9-85985905f228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:20.056881 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-4ecae70c-2382-49b8-9fe9-85985905f228 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:20.058095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-4ecae70c-2382-49b8-9fe9-85985905f228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:20.069023 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:20.140890 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 376/758] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:20 2022] POST /identity/v3/auth/tokens => generated 1510 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:20.515613 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868275a8-e5ec-4faf-a5d7-301db64dcad1 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:20.577665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:20.638301 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868275a8-e5ec-4faf-a5d7-301db64dcad1 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:20.682989 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e987d-83ef-4e44-b312-a44033b67c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:20.683630 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e987d-83ef-4e44-b312-a44033b67c82 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:20.684242 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e987d-83ef-4e44-b312-a44033b67c82 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:20.684242 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e987d-83ef-4e44-b312-a44033b67c82 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:20.684751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e987d-83ef-4e44-b312-a44033b67c82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:20.686135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e987d-83ef-4e44-b312-a44033b67c82 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-a19e987d-83ef-4e44-b312-a44033b67c82 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:20.701471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:20.702517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:20.703462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:20.703462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:20.703462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:20.703462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:20.703462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:20.703462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:20.703462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:20.703462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:20.703462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:20.703462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:20.703462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:20.703462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:20.703462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:51:20.703462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:20.703462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 383/759] 10.222.0.121 () {56 vars in 1137 bytes} [Fri Aug 26 00:51:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:51:20.714204 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecae70c-2382-49b8-9fe9-85985905f228 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:20.846555 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecae70c-2382-49b8-9fe9-85985905f228 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:20.893561 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7488e0d-28e3-41ff-9170-4805612a11a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:20.894172 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488e0d-28e3-41ff-9170-4805612a11a6 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:20.894449 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488e0d-28e3-41ff-9170-4805612a11a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:20.894717 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488e0d-28e3-41ff-9170-4805612a11a6 None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:20.895388 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7488e0d-28e3-41ff-9170-4805612a11a6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:20.895681 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7488e0d-28e3-41ff-9170-4805612a11a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:20.897070 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7488e0d-28e3-41ff-9170-4805612a11a6 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:20.904090 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 377/760] 10.222.0.121 () {56 vars in 1131 bytes} [Fri Aug 26 00:51:20 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:20.912304 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e987d-83ef-4e44-b312-a44033b67c82 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:21.028337 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31daa4-f94e-4a00-8ebb-c6580b7af50f None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:21.028625 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31daa4-f94e-4a00-8ebb-c6580b7af50f None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:21.028957 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31daa4-f94e-4a00-8ebb-c6580b7af50f None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:21.030347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 378/761] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:51:21.035274 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb24da-b337-49e7-82c5-7cd94899bb51 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:21.035565 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb24da-b337-49e7-82c5-7cd94899bb51 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:21.035849 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb24da-b337-49e7-82c5-7cd94899bb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:21.040001 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e987d-83ef-4e44-b312-a44033b67c82 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:21.043653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:21.054947 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-0ecb24da-b337-49e7-82c5-7cd94899bb51 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:21.056939 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:21.057059 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-0ecb24da-b337-49e7-82c5-7cd94899bb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:21.079976 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2f56f-e150-4328-bc9b-90b74004432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:21.080594 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2f56f-e150-4328-bc9b-90b74004432c None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:21.080867 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2f56f-e150-4328-bc9b-90b74004432c None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:21.081139 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2f56f-e150-4328-bc9b-90b74004432c None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:21.081779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2f56f-e150-4328-bc9b-90b74004432c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:21.082080 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2f56f-e150-4328-bc9b-90b74004432c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:21.083741 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2f56f-e150-4328-bc9b-90b74004432c None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:21.089899 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 384/762] 10.222.0.121 () {56 vars in 1131 bytes} [Fri Aug 26 00:51:20 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:21.139082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 379/763] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:21 2022] POST /identity/v3/auth/tokens => generated 1510 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:51:21.478294 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2f56f-e150-4328-bc9b-90b74004432c None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:21.584187 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2f56f-e150-4328-bc9b-90b74004432c None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:21.621749 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5469f85-e6f8-42d0-89bc-ef7d57d80e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:21.622327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5469f85-e6f8-42d0-89bc-ef7d57d80e40 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:21.622686 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5469f85-e6f8-42d0-89bc-ef7d57d80e40 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:21.623037 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5469f85-e6f8-42d0-89bc-ef7d57d80e40 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:21.623625 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5469f85-e6f8-42d0-89bc-ef7d57d80e40 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:21.625004 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5469f85-e6f8-42d0-89bc-ef7d57d80e40 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-d5469f85-e6f8-42d0-89bc-ef7d57d80e40 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:21.634331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:21.635626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:21.639583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:21.639583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:21.639583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:21.639583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:21.639583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:21.639583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:21.639583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:21.639583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:21.639583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:21.639583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:21.639583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:21.639583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:21.639583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:51:21.639583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:21.639583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 385/764] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:51:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:21.642217 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb24da-b337-49e7-82c5-7cd94899bb51 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:21.755130 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb24da-b337-49e7-82c5-7cd94899bb51 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:21.791619 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41db50-367e-4588-b732-78a9de7d2248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:21.792224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41db50-367e-4588-b732-78a9de7d2248 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:21.792497 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41db50-367e-4588-b732-78a9de7d2248 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:21.792763 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41db50-367e-4588-b732-78a9de7d2248 None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:21.793392 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41db50-367e-4588-b732-78a9de7d2248 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:21.793691 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41db50-367e-4588-b732-78a9de7d2248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:21.795243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41db50-367e-4588-b732-78a9de7d2248 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:21.796373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:21.800547 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 380/765] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:51:21 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:21.806078 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5469f85-e6f8-42d0-89bc-ef7d57d80e40 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:21.850113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:21.908907 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5469f85-e6f8-42d0-89bc-ef7d57d80e40 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:21.943088 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a033ac-c8b9-4eaf-be57-4530ff4352ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:21.943680 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a033ac-c8b9-4eaf-be57-4530ff4352ee None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:21.943958 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a033ac-c8b9-4eaf-be57-4530ff4352ee None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:21.944232 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a033ac-c8b9-4eaf-be57-4530ff4352ee None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:21.944881 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a033ac-c8b9-4eaf-be57-4530ff4352ee None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:21.945210 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a033ac-c8b9-4eaf-be57-4530ff4352ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:21.946569 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a033ac-c8b9-4eaf-be57-4530ff4352ee None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:21.951461 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 386/766] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:51:21 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:21.957256 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41db50-367e-4588-b732-78a9de7d2248 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:22.060025 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41db50-367e-4588-b732-78a9de7d2248 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:22.096675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b579dd8-43c8-4776-8d44-1fb42632e112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:22.097449 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b579dd8-43c8-4776-8d44-1fb42632e112 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:22.097840 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b579dd8-43c8-4776-8d44-1fb42632e112 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:22.098298 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b579dd8-43c8-4776-8d44-1fb42632e112 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:22.099146 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b579dd8-43c8-4776-8d44-1fb42632e112 None admin] RBAC: Adding query filter params (interface=public, service_id=b10c6582fcae4ccf90e0be729d09dc22, region_id=RegionOne) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:22.099570 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b579dd8-43c8-4776-8d44-1fb42632e112 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:22.101103 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b579dd8-43c8-4776-8d44-1fb42632e112 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:22.106396 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 381/767] 10.222.0.121 () {56 vars in 1256 bytes} [Fri Aug 26 00:51:21 2022] GET /identity/v3/endpoints?service_id=b10c6582fcae4ccf90e0be729d09dc22&interface=public®ion_id=RegionOne => generated 195 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:22.111936 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a033ac-c8b9-4eaf-be57-4530ff4352ee None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:22.217064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a033ac-c8b9-4eaf-be57-4530ff4352ee None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:22.219613 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:22.258721 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4a5b3-4d54-4f4c-8dc9-245e37a51c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:22.259856 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4a5b3-4d54-4f4c-8dc9-245e37a51c5f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:22.260136 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4a5b3-4d54-4f4c-8dc9-245e37a51c5f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:22.260412 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4a5b3-4d54-4f4c-8dc9-245e37a51c5f None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:22.261028 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4a5b3-4d54-4f4c-8dc9-245e37a51c5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:22.262413 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4a5b3-4d54-4f4c-8dc9-245e37a51c5f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:22.268767 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 387/768] 10.222.0.121 () {56 vars in 1092 bytes} [Fri Aug 26 00:51:22 2022] GET /identity/v3/services => generated 1247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:51:23.331703 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1955dd-221b-42b8-87d4-2be825d7dfe9 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:23.332218 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1955dd-221b-42b8-87d4-2be825d7dfe9 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:23.332404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1955dd-221b-42b8-87d4-2be825d7dfe9 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:23.333796 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 382/769] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:23.340015 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e05bd-e76d-4032-b7a1-c1c25e468378 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:23.340696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e05bd-e76d-4032-b7a1-c1c25e468378 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:23.340696 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e05bd-e76d-4032-b7a1-c1c25e468378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:23.359694 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-d96e05bd-e76d-4032-b7a1-c1c25e468378 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:23.360888 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-d96e05bd-e76d-4032-b7a1-c1c25e468378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:23.439160 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 388/770] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:23 2022] POST /identity/v3/auth/tokens => generated 1510 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:23.767219 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1955dd-221b-42b8-87d4-2be825d7dfe9 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:23.832915 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:23.874447 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1955dd-221b-42b8-87d4-2be825d7dfe9 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:23.910872 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd504c4c-0298-42ef-8dc7-451cb82e7172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:23.911480 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd504c4c-0298-42ef-8dc7-451cb82e7172 None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:23.911757 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd504c4c-0298-42ef-8dc7-451cb82e7172 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:23.912026 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd504c4c-0298-42ef-8dc7-451cb82e7172 None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:23.912691 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd504c4c-0298-42ef-8dc7-451cb82e7172 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:23.914114 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd504c4c-0298-42ef-8dc7-451cb82e7172 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:24.022868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 383/771] 10.222.0.121 () {60 vars in 1146 bytes} [Fri Aug 26 00:51:23 2022] POST /identity/v3/services => generated 270 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:51:24.531682 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df32c3e-09f9-4c0d-99b1-2c8b4943d28a None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:24.531682 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df32c3e-09f9-4c0d-99b1-2c8b4943d28a None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:24.532284 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df32c3e-09f9-4c0d-99b1-2c8b4943d28a None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:24.533083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 389/772] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:24.539102 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895be43-a850-42c4-9821-46ee69e03121 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:24.539555 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895be43-a850-42c4-9821-46ee69e03121 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:24.539647 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895be43-a850-42c4-9821-46ee69e03121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:24.558510 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-5895be43-a850-42c4-9821-46ee69e03121 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:24.559897 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-5895be43-a850-42c4-9821-46ee69e03121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:24.633532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 384/773] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:24 2022] POST /identity/v3/auth/tokens => generated 1620 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:24.963254 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df32c3e-09f9-4c0d-99b1-2c8b4943d28a None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:25.061745 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:25.067590 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df32c3e-09f9-4c0d-99b1-2c8b4943d28a None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:25.102170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd9a9b-813d-47b3-967c-7072c5117d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:25.102800 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd9a9b-813d-47b3-967c-7072c5117d82 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:25.103106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd9a9b-813d-47b3-967c-7072c5117d82 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:25.103376 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd9a9b-813d-47b3-967c-7072c5117d82 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:25.103953 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd9a9b-813d-47b3-967c-7072c5117d82 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:25.105322 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd9a9b-813d-47b3-967c-7072c5117d82 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-8fcd9a9b-813d-47b3-967c-7072c5117d82 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:25.114835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:25.116087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:25.117765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:25.117765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:25.117765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:25.117765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:25.117765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:25.117765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:25.117765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:25.117765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:25.117765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:25.117765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:25.117765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:25.117765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:25.117765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:51:25.117765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:25.117765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 390/774] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:51:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:25.122455 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895be43-a850-42c4-9821-46ee69e03121 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:25.173800 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:25.225087 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895be43-a850-42c4-9821-46ee69e03121 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:25.266182 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103f48e-7e3a-4220-b2a2-a51a8a94997b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:25.266786 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103f48e-7e3a-4220-b2a2-a51a8a94997b None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:25.267088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103f48e-7e3a-4220-b2a2-a51a8a94997b None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:25.267352 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103f48e-7e3a-4220-b2a2-a51a8a94997b None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:25.267975 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103f48e-7e3a-4220-b2a2-a51a8a94997b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:25.268266 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103f48e-7e3a-4220-b2a2-a51a8a94997b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:25.269632 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d103f48e-7e3a-4220-b2a2-a51a8a94997b None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:25.274971 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 385/775] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:51:25 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:25.280608 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd9a9b-813d-47b3-967c-7072c5117d82 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:25.402648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd9a9b-813d-47b3-967c-7072c5117d82 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:25.437242 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855418d4-b6f8-4a64-94c0-fb2e7e865fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:25.437854 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855418d4-b6f8-4a64-94c0-fb2e7e865fa0 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:25.438128 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855418d4-b6f8-4a64-94c0-fb2e7e865fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:25.438404 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855418d4-b6f8-4a64-94c0-fb2e7e865fa0 None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:25.439066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855418d4-b6f8-4a64-94c0-fb2e7e865fa0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:25.439372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855418d4-b6f8-4a64-94c0-fb2e7e865fa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:25.440786 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855418d4-b6f8-4a64-94c0-fb2e7e865fa0 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:25.446807 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 391/776] 10.222.0.121 () {56 vars in 1119 bytes} [Fri Aug 26 00:51:25 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:25.452708 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103f48e-7e3a-4220-b2a2-a51a8a94997b None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:25.561164 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103f48e-7e3a-4220-b2a2-a51a8a94997b None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:25.576019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:25.597141 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc37c6d-7c5b-427d-9a5f-2ab253d760f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:25.597769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37c6d-7c5b-427d-9a5f-2ab253d760f9 None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:25.598032 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37c6d-7c5b-427d-9a5f-2ab253d760f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:25.598427 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37c6d-7c5b-427d-9a5f-2ab253d760f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:25.599524 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc37c6d-7c5b-427d-9a5f-2ab253d760f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:25.600990 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc37c6d-7c5b-427d-9a5f-2ab253d760f9 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:25.683522 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 386/777] 10.222.0.121 () {60 vars in 1149 bytes} [Fri Aug 26 00:51:25 2022] POST /identity/v3/endpoints => generated 348 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:51:26.285086 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaabb3d-d910-427a-bbf4-e93c80897bc9 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:26.285635 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaabb3d-d910-427a-bbf4-e93c80897bc9 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:26.285635 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaabb3d-d910-427a-bbf4-e93c80897bc9 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:26.286979 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 392/778] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:51:26.292609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477d2fb-32de-462c-8f8e-c7d10be7ab79 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:26.292934 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477d2fb-32de-462c-8f8e-c7d10be7ab79 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:26.293174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477d2fb-32de-462c-8f8e-c7d10be7ab79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:26.312724 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-e477d2fb-32de-462c-8f8e-c7d10be7ab79 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:26.314047 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-e477d2fb-32de-462c-8f8e-c7d10be7ab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:26.395571 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 387/779] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:26 2022] POST /identity/v3/auth/tokens => generated 1620 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:26.734981 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaabb3d-d910-427a-bbf4-e93c80897bc9 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:26.764438 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:26.846323 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaabb3d-d910-427a-bbf4-e93c80897bc9 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:26.879515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211628f2-faef-431b-9cd8-ec455624caab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:26.880143 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211628f2-faef-431b-9cd8-ec455624caab None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:26.880419 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211628f2-faef-431b-9cd8-ec455624caab None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:26.880694 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211628f2-faef-431b-9cd8-ec455624caab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:26.881267 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211628f2-faef-431b-9cd8-ec455624caab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:26.883237 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211628f2-faef-431b-9cd8-ec455624caab None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-211628f2-faef-431b-9cd8-ec455624caab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:26.892050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:26.893181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:26.894372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:26.894372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:26.894372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:26.894372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:26.894372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:26.894372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:26.894372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:26.894372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:26.894372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:26.894372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:26.894372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:26.894372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:26.894372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:51:26.894372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:26.894372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 393/780] 10.222.0.121 () {56 vars in 1137 bytes} [Fri Aug 26 00:51:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:26.899212 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477d2fb-32de-462c-8f8e-c7d10be7ab79 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:26.998501 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:27.005136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477d2fb-32de-462c-8f8e-c7d10be7ab79 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:27.043375 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b715519-7c69-4adc-93b7-ebc30582fa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:27.044135 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b715519-7c69-4adc-93b7-ebc30582fa42 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:27.044418 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b715519-7c69-4adc-93b7-ebc30582fa42 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:27.044691 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b715519-7c69-4adc-93b7-ebc30582fa42 None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:27.045335 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b715519-7c69-4adc-93b7-ebc30582fa42 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:27.045638 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b715519-7c69-4adc-93b7-ebc30582fa42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:27.047047 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b715519-7c69-4adc-93b7-ebc30582fa42 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:27.051914 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 388/781] 10.222.0.121 () {56 vars in 1131 bytes} [Fri Aug 26 00:51:26 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:51:27.058193 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211628f2-faef-431b-9cd8-ec455624caab None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:27.156483 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:27.166638 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211628f2-faef-431b-9cd8-ec455624caab None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:27.202267 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da9382-b8f7-48ee-8e87-82f002763e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:27.202891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da9382-b8f7-48ee-8e87-82f002763e7a None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:27.203187 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da9382-b8f7-48ee-8e87-82f002763e7a None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:27.203476 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da9382-b8f7-48ee-8e87-82f002763e7a None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:27.204120 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da9382-b8f7-48ee-8e87-82f002763e7a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:27.204402 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da9382-b8f7-48ee-8e87-82f002763e7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:27.205787 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da9382-b8f7-48ee-8e87-82f002763e7a None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:27.211366 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 394/782] 10.222.0.121 () {56 vars in 1131 bytes} [Fri Aug 26 00:51:27 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:27.218375 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b715519-7c69-4adc-93b7-ebc30582fa42 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:27.323424 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b715519-7c69-4adc-93b7-ebc30582fa42 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:27.359130 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a84ab-192c-4ad1-8ad4-fe71d92e35cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:27.359765 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a84ab-192c-4ad1-8ad4-fe71d92e35cb None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:27.360017 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a84ab-192c-4ad1-8ad4-fe71d92e35cb None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:27.360286 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a84ab-192c-4ad1-8ad4-fe71d92e35cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:27.361048 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a84ab-192c-4ad1-8ad4-fe71d92e35cb None admin] RBAC: Adding query filter params (interface=public, service_id=63756afc770b410e95bc516be4314ae0, region_id=RegionOne) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:27.361295 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a84ab-192c-4ad1-8ad4-fe71d92e35cb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:27.362677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a84ab-192c-4ad1-8ad4-fe71d92e35cb None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:27.368729 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 389/783] 10.222.0.121 () {56 vars in 1256 bytes} [Fri Aug 26 00:51:27 2022] GET /identity/v3/endpoints?service_id=63756afc770b410e95bc516be4314ae0&interface=public®ion_id=RegionOne => generated 195 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:51:27.374593 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da9382-b8f7-48ee-8e87-82f002763e7a None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:27.480943 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da9382-b8f7-48ee-8e87-82f002763e7a None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:27.522921 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24ec30-1cf4-4d67-ae81-42e57d6386bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:27.523551 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24ec30-1cf4-4d67-ae81-42e57d6386bb None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:27.523832 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24ec30-1cf4-4d67-ae81-42e57d6386bb None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:27.524102 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24ec30-1cf4-4d67-ae81-42e57d6386bb None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:27.524701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24ec30-1cf4-4d67-ae81-42e57d6386bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:27.526054 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24ec30-1cf4-4d67-ae81-42e57d6386bb None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:27.532842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 395/784] 10.222.0.121 () {56 vars in 1092 bytes} [Fri Aug 26 00:51:27 2022] GET /identity/v3/services => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:51:27.965501 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed69961-614f-4c7c-8e85-370e1d7399c5 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:27.966065 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed69961-614f-4c7c-8e85-370e1d7399c5 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:27.966174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed69961-614f-4c7c-8e85-370e1d7399c5 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:27.967699 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 390/785] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:27.972957 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50cf3b-f2f1-4768-8f2d-13e3174e8331 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:27.973248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50cf3b-f2f1-4768-8f2d-13e3174e8331 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:27.973528 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50cf3b-f2f1-4768-8f2d-13e3174e8331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:27.992353 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-fc50cf3b-f2f1-4768-8f2d-13e3174e8331 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:27.993557 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-fc50cf3b-f2f1-4768-8f2d-13e3174e8331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:28.007835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:28.061719 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 396/786] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:27 2022] POST /identity/v3/auth/tokens => generated 1620 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:28.388982 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed69961-614f-4c7c-8e85-370e1d7399c5 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:28.415344 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:28.496067 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed69961-614f-4c7c-8e85-370e1d7399c5 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:28.533336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafedee-2503-4c18-b444-5f05600bcb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:28.533989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafedee-2503-4c18-b444-5f05600bcb5b None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:28.534271 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafedee-2503-4c18-b444-5f05600bcb5b None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:28.534543 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafedee-2503-4c18-b444-5f05600bcb5b None admin] PATH_INFO: `/v3/projects` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:28.535226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafedee-2503-4c18-b444-5f05600bcb5b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:28.536673 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafedee-2503-4c18-b444-5f05600bcb5b None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:28.539855 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: WARNING keystone.server.flask.common [None req-bbafedee-2503-4c18-b444-5f05600bcb5b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 26 00:51:28.599405 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.sql.core [None req-bbafedee-2503-4c18-b444-5f05600bcb5b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 00:51:28.599405 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 00:51:28.599405 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [parameters: {'id': '675f73841365459f8ce71039a9bcdf21', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 00:51:28.599405 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88530) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 00:51:28.631993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-bbafedee-2503-4c18-b444-5f05600bcb5b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 675f73841365459f8ce71039a9bcdf21.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 675f73841365459f8ce71039a9bcdf21. Aug 26 00:51:28.631993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:28.631993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:51:28.631993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:51:28.631993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:51:28.631993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:51:28.631993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:51:28.631993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:51:28.631993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:51:28.631993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:51:28.631993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:51:28.631993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:51:28.631993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application result.read() Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 26 00:51:28.633770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application yield resource Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise self.value Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application session.commit() Aug 26 00:51:28.635768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self.session.flush() Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application compat.raise_( Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 00:51:28.637616 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 00:51:28.639695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 00:51:28.639695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 00:51:28.639695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 00:51:28.639695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 00:51:28.639695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 00:51:28.639695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 00:51:28.639695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 00:51:28.639695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 00:51:28.639695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 00:51:28.639695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 00:51:28.639695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 00:51:28.639695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 00:51:28.639695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 00:51:28.639695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 00:51:28.639695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application result.read() Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:51:28.641540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:51:28.643566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:51:28.643566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:51:28.643566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:51:28.643566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:51:28.643566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:51:28.643566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:51:28.643566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 00:51:28.643566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 00:51:28.643566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [parameters: {'id': '675f73841365459f8ce71039a9bcdf21', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 00:51:28.643566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 00:51:28.643566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:28.643566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:28.643566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:28.643566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:28.643566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:28.645091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:28.646798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:28.646798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 26 00:51:28.646798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 26 00:51:28.646798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:28.646798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:28.646798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 26 00:51:28.646798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 26 00:51:28.646798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 675f73841365459f8ce71039a9bcdf21. Aug 26 00:51:28.646798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:28.646798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 391/787] 10.222.0.121 () {60 vars in 1145 bytes} [Fri Aug 26 00:51:28 2022] POST /identity/v3/projects => generated 262 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:28.648430 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50cf3b-f2f1-4768-8f2d-13e3174e8331 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:28.758213 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50cf3b-f2f1-4768-8f2d-13e3174e8331 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:28.792880 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f94c26-5028-43f7-b84d-00a3edb1b007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:28.793513 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f94c26-5028-43f7-b84d-00a3edb1b007 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:28.793791 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f94c26-5028-43f7-b84d-00a3edb1b007 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:28.794063 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f94c26-5028-43f7-b84d-00a3edb1b007 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:28.800952 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f94c26-5028-43f7-b84d-00a3edb1b007 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:28.802418 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f94c26-5028-43f7-b84d-00a3edb1b007 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:28.814208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-68f94c26-5028-43f7-b84d-00a3edb1b007 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:51:28.814208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:28.814208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:28.814208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:28.814208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:28.814208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:28.814208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:28.814208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:28.814208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:28.814208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:28.814208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:28.814208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:28.814208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:51:28.814208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:51:28.814208 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:28.815261 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:28.816185 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:51:28.816185 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:51:28.816185 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:51:28.816185 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:51:28.816185 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:51:28.816185 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:51:28.816185 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:51:28.816185 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:28.816185 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 397/788] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:28.822572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafedee-2503-4c18-b444-5f05600bcb5b None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:28.907114 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:28.929903 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafedee-2503-4c18-b444-5f05600bcb5b None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:28.970605 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dafb2-47b6-41ec-ae74-f1333dc6ec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:28.971363 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dafb2-47b6-41ec-ae74-f1333dc6ec8d None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:28.971526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dafb2-47b6-41ec-ae74-f1333dc6ec8d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:28.971794 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dafb2-47b6-41ec-ae74-f1333dc6ec8d None admin] PATH_INFO: `/v3/projects` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:28.972482 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dafb2-47b6-41ec-ae74-f1333dc6ec8d None admin] RBAC: Adding query filter params (name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:28.973440 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dafb2-47b6-41ec-ae74-f1333dc6ec8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:28.975110 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dafb2-47b6-41ec-ae74-f1333dc6ec8d None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:28.998939 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 392/789] 10.222.0.121 () {56 vars in 1117 bytes} [Fri Aug 26 00:51:28 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:29.793253 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad63c-913b-4ae3-9ad7-e23a661355fe None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:29.793801 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad63c-913b-4ae3-9ad7-e23a661355fe None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:29.793801 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad63c-913b-4ae3-9ad7-e23a661355fe None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:29.795298 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 398/790] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:29.800587 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5c581-5d11-426e-b869-ac28989f190d None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:29.800873 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5c581-5d11-426e-b869-ac28989f190d None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:29.801151 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5c581-5d11-426e-b869-ac28989f190d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:29.820199 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-03c5c581-5d11-426e-b869-ac28989f190d None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:29.821701 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-03c5c581-5d11-426e-b869-ac28989f190d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:29.888835 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 393/791] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:29 2022] POST /identity/v3/auth/tokens => generated 1620 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:30.219141 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ad63c-913b-4ae3-9ad7-e23a661355fe None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:30.231496 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:30.338849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ad63c-913b-4ae3-9ad7-e23a661355fe None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:30.371529 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3db060-56ee-4404-a29d-6672f5b58a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:30.372147 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3db060-56ee-4404-a29d-6672f5b58a3b None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:30.372425 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3db060-56ee-4404-a29d-6672f5b58a3b None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:30.372698 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3db060-56ee-4404-a29d-6672f5b58a3b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:30.373269 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3db060-56ee-4404-a29d-6672f5b58a3b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:30.374629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3db060-56ee-4404-a29d-6672f5b58a3b None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-9a3db060-56ee-4404-a29d-6672f5b58a3b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:30.383624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:30.384760 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:30.385849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:30.385849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:30.385849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:30.385849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:30.385849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:30.385849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:30.385849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:30.385849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:30.385849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:30.385849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:30.385849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:30.385849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:30.385849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:51:30.385849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:30.385849 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 399/792] 10.222.0.121 () {56 vars in 1137 bytes} [Fri Aug 26 00:51:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:30.390618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5c581-5d11-426e-b869-ac28989f190d None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:30.458116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:30.493108 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5c581-5d11-426e-b869-ac28989f190d None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:30.528203 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740db67-2744-4a2e-a072-d74fe91e8b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:30.528804 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740db67-2744-4a2e-a072-d74fe91e8b84 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:30.529078 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740db67-2744-4a2e-a072-d74fe91e8b84 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:30.529345 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740db67-2744-4a2e-a072-d74fe91e8b84 None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:30.529962 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740db67-2744-4a2e-a072-d74fe91e8b84 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:30.530256 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740db67-2744-4a2e-a072-d74fe91e8b84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:30.531658 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740db67-2744-4a2e-a072-d74fe91e8b84 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:30.536748 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 394/793] 10.222.0.121 () {56 vars in 1131 bytes} [Fri Aug 26 00:51:30 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:30.542574 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3db060-56ee-4404-a29d-6672f5b58a3b None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:30.634136 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:30.664790 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3db060-56ee-4404-a29d-6672f5b58a3b None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:30.707453 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633d157-3f99-4d2e-9c18-321cfbc9f737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:30.708244 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633d157-3f99-4d2e-9c18-321cfbc9f737 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:30.708618 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633d157-3f99-4d2e-9c18-321cfbc9f737 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:30.708984 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633d157-3f99-4d2e-9c18-321cfbc9f737 None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:30.709784 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633d157-3f99-4d2e-9c18-321cfbc9f737 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:30.710183 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633d157-3f99-4d2e-9c18-321cfbc9f737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:30.711722 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633d157-3f99-4d2e-9c18-321cfbc9f737 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:30.717055 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 400/794] 10.222.0.121 () {56 vars in 1131 bytes} [Fri Aug 26 00:51:30 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:30.723078 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740db67-2744-4a2e-a072-d74fe91e8b84 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:30.831140 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740db67-2744-4a2e-a072-d74fe91e8b84 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:30.862747 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:30.869572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd6ace-cf2e-45e7-a751-dafdbac9cd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:30.870258 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd6ace-cf2e-45e7-a751-dafdbac9cd1d None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:30.870585 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd6ace-cf2e-45e7-a751-dafdbac9cd1d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:30.870949 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd6ace-cf2e-45e7-a751-dafdbac9cd1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:30.871681 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd6ace-cf2e-45e7-a751-dafdbac9cd1d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:30.873172 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd6ace-cf2e-45e7-a751-dafdbac9cd1d None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:30.971771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 395/795] 10.222.0.121 () {60 vars in 1149 bytes} [Fri Aug 26 00:51:30 2022] POST /identity/v3/endpoints => generated 349 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:51:31.299338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c4979-c416-412e-8ca7-b2c4b21e8342 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:31.299863 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c4979-c416-412e-8ca7-b2c4b21e8342 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:31.299863 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c4979-c416-412e-8ca7-b2c4b21e8342 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:31.301462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 401/796] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:31.307628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd3c60-73b8-4aa1-a64c-99d4a2dbc36d None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:31.307912 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd3c60-73b8-4aa1-a64c-99d4a2dbc36d None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:31.308185 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd3c60-73b8-4aa1-a64c-99d4a2dbc36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:31.326866 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-febd3c60-73b8-4aa1-a64c-99d4a2dbc36d None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:31.328059 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-febd3c60-73b8-4aa1-a64c-99d4a2dbc36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:31.420612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 396/797] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:31 2022] POST /identity/v3/auth/tokens => generated 1620 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:31.754616 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c4979-c416-412e-8ca7-b2c4b21e8342 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:31.865263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c4979-c416-412e-8ca7-b2c4b21e8342 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:31.902077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3d252-9e7b-4763-9e17-af9d8d0e9ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:31.902684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3d252-9e7b-4763-9e17-af9d8d0e9ead None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:31.902995 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3d252-9e7b-4763-9e17-af9d8d0e9ead None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:31.903272 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3d252-9e7b-4763-9e17-af9d8d0e9ead None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:31.903910 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3d252-9e7b-4763-9e17-af9d8d0e9ead None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:31.905345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3d252-9e7b-4763-9e17-af9d8d0e9ead None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:31.907876 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: WARNING keystone.server.flask.common [None req-c7b3d252-9e7b-4763-9e17-af9d8d0e9ead None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 26 00:51:31.916217 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:31.964359 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.sql.core [None req-c7b3d252-9e7b-4763-9e17-af9d8d0e9ead None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 00:51:31.964359 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 00:51:31.964359 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [parameters: {'user_id': 'd223a0eae3aa49c39cee5a5db7550c7a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 00:51:31.964359 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88531) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 00:51:31.982091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-c7b3d252-9e7b-4763-9e17-af9d8d0e9ead None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 00:51:31.982091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:31.982091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:51:31.982091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:51:31.982091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:51:31.982091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:51:31.982091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:51:31.982091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:51:31.982091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:51:31.982091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:51:31.982091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:51:31.982091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:51:31.982091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:51:31.982091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application result.read() Aug 26 00:51:31.982091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:51:31.993234 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application yield resource Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise self.value Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application session.commit() Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 00:51:31.994391 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self.session.flush() Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application compat.raise_( Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 00:51:31.995286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:51:31.996176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application result.read() Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:51:31.997061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:51:31.999125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:51:31.999125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:51:31.999125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:51:31.999125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:51:31.999125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 00:51:31.999125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 00:51:31.999125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd223a0eae3aa49c39cee5a5db7550c7a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 00:51:31.999125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 00:51:31.999125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:31.999125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:31.999125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:31.999125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:31.999125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:31.999125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:31.999125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 26 00:51:32.000354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 26 00:51:32.001424 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 26 00:51:32.001424 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 26 00:51:32.001424 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 00:51:32.001424 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 00:51:32.001424 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 00:51:32.001424 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:32.001424 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 402/798] 10.222.0.121 () {60 vars in 1136 bytes} [Fri Aug 26 00:51:31 2022] POST /identity/v3/users => generated 160 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:32.001974 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd3c60-73b8-4aa1-a64c-99d4a2dbc36d None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:32.093999 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd3c60-73b8-4aa1-a64c-99d4a2dbc36d None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:32.109239 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:32.130026 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc56233-93d8-4aac-ac43-4226249b5027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:32.130677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc56233-93d8-4aac-ac43-4226249b5027 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:32.130999 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc56233-93d8-4aac-ac43-4226249b5027 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:32.131271 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc56233-93d8-4aac-ac43-4226249b5027 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:32.140919 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc56233-93d8-4aac-ac43-4226249b5027 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:32.142385 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc56233-93d8-4aac-ac43-4226249b5027 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-efc56233-93d8-4aac-ac43-4226249b5027 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:51:32.154928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:32.161452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:32.167176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:32.167176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:32.167176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:51:32.167176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:51:32.167176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:51:32.167176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:51:32.167176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:51:32.167176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:51:32.167176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:51:32.167176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:32.167176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 397/799] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:51:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:32.167977 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3d252-9e7b-4763-9e17-af9d8d0e9ead None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:32.270963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3d252-9e7b-4763-9e17-af9d8d0e9ead None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:32.308438 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d174c6b-3023-4f6b-8fc2-9a0fe1a3a1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:32.309126 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d174c6b-3023-4f6b-8fc2-9a0fe1a3a1ea None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:32.309395 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d174c6b-3023-4f6b-8fc2-9a0fe1a3a1ea None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:32.309666 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d174c6b-3023-4f6b-8fc2-9a0fe1a3a1ea None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:32.310452 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d174c6b-3023-4f6b-8fc2-9a0fe1a3a1ea None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:32.310756 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d174c6b-3023-4f6b-8fc2-9a0fe1a3a1ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:32.312481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d174c6b-3023-4f6b-8fc2-9a0fe1a3a1ea None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:32.353525 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 403/800] 10.222.0.121 () {56 vars in 1106 bytes} [Fri Aug 26 00:51:32 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:33.302481 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee247d7-8adb-41a5-bfd4-a3c9961da15a None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:33.303049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee247d7-8adb-41a5-bfd4-a3c9961da15a None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:33.303049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee247d7-8adb-41a5-bfd4-a3c9961da15a None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:33.304398 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 398/801] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:33.309923 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c41b9d-a08b-4532-a203-297986311352 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:33.310375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c41b9d-a08b-4532-a203-297986311352 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:33.310499 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c41b9d-a08b-4532-a203-297986311352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:33.329744 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-b6c41b9d-a08b-4532-a203-297986311352 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:33.332898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-b6c41b9d-a08b-4532-a203-297986311352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:33.387275 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:33.404592 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 404/802] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:33 2022] POST /identity/v3/auth/tokens => generated 1620 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:33.747467 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee247d7-8adb-41a5-bfd4-a3c9961da15a None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:33.854950 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee247d7-8adb-41a5-bfd4-a3c9961da15a None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:33.889685 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc668d-f68e-4582-9d82-59617491872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:33.890320 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc668d-f68e-4582-9d82-59617491872e None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:33.890598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc668d-f68e-4582-9d82-59617491872e None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:33.890895 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc668d-f68e-4582-9d82-59617491872e None admin] PATH_INFO: `/v3/services/compute` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:33.891487 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc668d-f68e-4582-9d82-59617491872e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:33.892869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc668d-f68e-4582-9d82-59617491872e None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-36bc668d-f68e-4582-9d82-59617491872e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:33.906378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:33.907777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:33.908820 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:33.908820 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:33.908820 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:33.908820 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:33.908820 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:33.908820 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:33.908820 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:33.908820 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:33.908820 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:33.908820 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:33.908820 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:33.908820 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:33.908820 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:51:33.908820 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:33.908820 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 399/803] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:51:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:33.917974 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c41b9d-a08b-4532-a203-297986311352 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:34.021244 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c41b9d-a08b-4532-a203-297986311352 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:34.058754 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bb7cb-1dcf-4da8-8132-ea1c066f4a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:34.059429 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bb7cb-1dcf-4da8-8132-ea1c066f4a1f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:34.059689 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bb7cb-1dcf-4da8-8132-ea1c066f4a1f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:34.059963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bb7cb-1dcf-4da8-8132-ea1c066f4a1f None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:34.060591 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bb7cb-1dcf-4da8-8132-ea1c066f4a1f None admin] RBAC: Adding query filter params (name=compute) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:34.060880 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bb7cb-1dcf-4da8-8132-ea1c066f4a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:34.062248 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bb7cb-1dcf-4da8-8132-ea1c066f4a1f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:34.067752 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 405/804] 10.222.0.121 () {56 vars in 1117 bytes} [Fri Aug 26 00:51:33 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:34.073294 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc668d-f68e-4582-9d82-59617491872e None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:34.114279 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:34.178235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc668d-f68e-4582-9d82-59617491872e None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:34.239561 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d002101-d132-403f-87ae-dbd4f29790da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:34.240175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d002101-d132-403f-87ae-dbd4f29790da None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:34.240456 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d002101-d132-403f-87ae-dbd4f29790da None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:34.240733 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d002101-d132-403f-87ae-dbd4f29790da None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:34.241400 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d002101-d132-403f-87ae-dbd4f29790da None admin] RBAC: Adding query filter params (type=compute) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:34.241704 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d002101-d132-403f-87ae-dbd4f29790da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:34.243874 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d002101-d132-403f-87ae-dbd4f29790da None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:34.249783 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 400/805] 10.222.0.121 () {56 vars in 1117 bytes} [Fri Aug 26 00:51:34 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:36.630221 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45d94f-5398-40cf-8313-9bd1af844d8d None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:36.630720 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45d94f-5398-40cf-8313-9bd1af844d8d None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:36.630881 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45d94f-5398-40cf-8313-9bd1af844d8d None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:36.633082 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 406/806] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:36.638781 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad4d44-c4e0-49be-a74c-e67f63788f9d None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:36.639904 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad4d44-c4e0-49be-a74c-e67f63788f9d None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:36.639904 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad4d44-c4e0-49be-a74c-e67f63788f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:36.659013 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-5dad4d44-c4e0-49be-a74c-e67f63788f9d None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:36.660221 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-5dad4d44-c4e0-49be-a74c-e67f63788f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:36.741500 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 401/807] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:36 2022] POST /identity/v3/auth/tokens => generated 1620 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:51:37.088845 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45d94f-5398-40cf-8313-9bd1af844d8d None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:37.144167 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:37.196907 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45d94f-5398-40cf-8313-9bd1af844d8d None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:37.231077 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daf85e-2d7b-40c8-a72b-648d78d3a0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:37.231685 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daf85e-2d7b-40c8-a72b-648d78d3a0a3 None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:37.231964 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daf85e-2d7b-40c8-a72b-648d78d3a0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:37.232237 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daf85e-2d7b-40c8-a72b-648d78d3a0a3 None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:37.232892 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daf85e-2d7b-40c8-a72b-648d78d3a0a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:37.234260 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daf85e-2d7b-40c8-a72b-648d78d3a0a3 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:37.309442 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 407/808] 10.222.0.121 () {60 vars in 1146 bytes} [Fri Aug 26 00:51:37 2022] POST /identity/v3/services => generated 243 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:51:39.570846 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639495c4-caa2-4d43-a27a-682dbec49e55 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:39.571430 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639495c4-caa2-4d43-a27a-682dbec49e55 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:39.571430 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639495c4-caa2-4d43-a27a-682dbec49e55 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:39.572762 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 402/809] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:39.578643 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c45d5-e54a-4d34-9129-eb1f8de02edc None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:39.579241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c45d5-e54a-4d34-9129-eb1f8de02edc None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:39.579241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c45d5-e54a-4d34-9129-eb1f8de02edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:39.598131 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-3a2c45d5-e54a-4d34-9129-eb1f8de02edc None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:39.599394 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-3a2c45d5-e54a-4d34-9129-eb1f8de02edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:39.687699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 408/810] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:39 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:40.026026 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639495c4-caa2-4d43-a27a-682dbec49e55 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:40.061294 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:40.133959 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639495c4-caa2-4d43-a27a-682dbec49e55 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:40.168179 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f932f7-9920-47d0-80ff-f15fc462b246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:40.168858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f932f7-9920-47d0-80ff-f15fc462b246 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:40.169142 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f932f7-9920-47d0-80ff-f15fc462b246 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:40.169411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f932f7-9920-47d0-80ff-f15fc462b246 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:40.169989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f932f7-9920-47d0-80ff-f15fc462b246 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:40.171396 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f932f7-9920-47d0-80ff-f15fc462b246 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-82f932f7-9920-47d0-80ff-f15fc462b246 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:40.180314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:40.181343 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:40.182245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:40.182245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:40.182245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:40.182245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:40.182245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:40.182245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:40.182245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:40.182245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:40.182245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:40.182245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:40.182245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:40.182245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:40.182245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:51:40.182245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:51:40.182245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 403/811] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:51:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:40.190563 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c45d5-e54a-4d34-9129-eb1f8de02edc None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:40.225910 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:40.289659 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c45d5-e54a-4d34-9129-eb1f8de02edc None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:40.327137 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ab552-d379-4efe-9f59-940c3a5c9220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:40.327763 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ab552-d379-4efe-9f59-940c3a5c9220 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:40.328059 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ab552-d379-4efe-9f59-940c3a5c9220 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:40.328325 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ab552-d379-4efe-9f59-940c3a5c9220 None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:40.328962 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ab552-d379-4efe-9f59-940c3a5c9220 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:40.329266 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ab552-d379-4efe-9f59-940c3a5c9220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:40.330661 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ab552-d379-4efe-9f59-940c3a5c9220 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:40.336638 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 409/812] 10.222.0.121 () {56 vars in 1117 bytes} [Fri Aug 26 00:51:40 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:40.342417 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f932f7-9920-47d0-80ff-f15fc462b246 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:40.436232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:40.442321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f932f7-9920-47d0-80ff-f15fc462b246 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:40.476215 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0c45f-8ddb-4c3e-8463-68c270104a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:40.476815 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0c45f-8ddb-4c3e-8463-68c270104a6a None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:40.477096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0c45f-8ddb-4c3e-8463-68c270104a6a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:40.477372 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0c45f-8ddb-4c3e-8463-68c270104a6a None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:40.478001 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0c45f-8ddb-4c3e-8463-68c270104a6a None admin] RBAC: Adding query filter params (type=compute) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:40.478321 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0c45f-8ddb-4c3e-8463-68c270104a6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:40.479710 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0c45f-8ddb-4c3e-8463-68c270104a6a None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:40.484386 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 404/813] 10.222.0.121 () {56 vars in 1117 bytes} [Fri Aug 26 00:51:40 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:40.490647 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ab552-d379-4efe-9f59-940c3a5c9220 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:40.588601 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:40.591945 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ab552-d379-4efe-9f59-940c3a5c9220 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:40.625836 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18001b-0723-423e-836c-20978ced05f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:40.626433 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18001b-0723-423e-836c-20978ced05f0 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:40.626717 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18001b-0723-423e-836c-20978ced05f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:40.627018 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18001b-0723-423e-836c-20978ced05f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:40.627713 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18001b-0723-423e-836c-20978ced05f0 None admin] RBAC: Adding query filter params (interface=public, service_id=4f2fb9b1b1ec4035b9f06603239f995b, region_id=RegionOne) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:40.628019 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18001b-0723-423e-836c-20978ced05f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:40.629383 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18001b-0723-423e-836c-20978ced05f0 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:40.635379 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 410/814] 10.222.0.121 () {56 vars in 1256 bytes} [Fri Aug 26 00:51:40 2022] GET /identity/v3/endpoints?service_id=4f2fb9b1b1ec4035b9f06603239f995b&interface=public®ion_id=RegionOne => generated 195 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:51:40.641038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0c45f-8ddb-4c3e-8463-68c270104a6a None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:40.743767 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0c45f-8ddb-4c3e-8463-68c270104a6a None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:40.777115 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c4d32-8a31-43a2-8847-bc5ed4bb0cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:40.777712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c4d32-8a31-43a2-8847-bc5ed4bb0cf0 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:40.777991 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c4d32-8a31-43a2-8847-bc5ed4bb0cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:40.778258 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c4d32-8a31-43a2-8847-bc5ed4bb0cf0 None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:40.778879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c4d32-8a31-43a2-8847-bc5ed4bb0cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:40.780251 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c4d32-8a31-43a2-8847-bc5ed4bb0cf0 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:40.786411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 405/815] 10.222.0.121 () {56 vars in 1092 bytes} [Fri Aug 26 00:51:40 2022] GET /identity/v3/services => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:51:42.990397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2b749-86cc-493f-a8eb-6b8033e9c360 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:42.991070 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2b749-86cc-493f-a8eb-6b8033e9c360 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:42.991070 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2b749-86cc-493f-a8eb-6b8033e9c360 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:42.992311 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 411/816] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:51:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:51:42.997410 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a44e87-91ee-4d47-93c0-534af91d4645 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:42.998135 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a44e87-91ee-4d47-93c0-534af91d4645 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:42.998135 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a44e87-91ee-4d47-93c0-534af91d4645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:43.016564 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-54a44e87-91ee-4d47-93c0-534af91d4645 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:51:43.017781 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-54a44e87-91ee-4d47-93c0-534af91d4645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:43.035801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:43.085836 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 406/817] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:51:42 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:51:43.412033 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2b749-86cc-493f-a8eb-6b8033e9c360 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:43.517584 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2b749-86cc-493f-a8eb-6b8033e9c360 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:43.551191 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9345655-6fa7-4459-90ab-9b6adb8a02c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:43.551814 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9345655-6fa7-4459-90ab-9b6adb8a02c9 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:43.552086 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9345655-6fa7-4459-90ab-9b6adb8a02c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:43.552353 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9345655-6fa7-4459-90ab-9b6adb8a02c9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:43.552923 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9345655-6fa7-4459-90ab-9b6adb8a02c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:43.554904 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9345655-6fa7-4459-90ab-9b6adb8a02c9 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-c9345655-6fa7-4459-90ab-9b6adb8a02c9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:51:43.563345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:51:43.564506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:51:43.565715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:51:43.565715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:51:43.565715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:51:43.565715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:51:43.565715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:51:43.565715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:51:43.565715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:51:43.565715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:51:43.565715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:51:43.565715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:51:43.565715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:51:43.565715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:51:43.565715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:51:43.565715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:51:43.565715 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 412/818] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:51:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:51:43.571443 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a44e87-91ee-4d47-93c0-534af91d4645 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:43.669743 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a44e87-91ee-4d47-93c0-534af91d4645 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:43.703574 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a60a2f-88ef-4fc7-ac86-d79956f2a936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:43.704179 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a60a2f-88ef-4fc7-ac86-d79956f2a936 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:43.704456 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a60a2f-88ef-4fc7-ac86-d79956f2a936 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:43.704728 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a60a2f-88ef-4fc7-ac86-d79956f2a936 None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:43.705377 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a60a2f-88ef-4fc7-ac86-d79956f2a936 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:43.705676 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a60a2f-88ef-4fc7-ac86-d79956f2a936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:43.707077 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a60a2f-88ef-4fc7-ac86-d79956f2a936 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:43.711737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 407/819] 10.222.0.121 () {56 vars in 1117 bytes} [Fri Aug 26 00:51:43 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:43.717532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9345655-6fa7-4459-90ab-9b6adb8a02c9 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:43.746439 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:43.817948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9345655-6fa7-4459-90ab-9b6adb8a02c9 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:43.850834 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631d428-bf1f-4f27-b91f-dc5ffa73e5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:43.851449 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631d428-bf1f-4f27-b91f-dc5ffa73e5c8 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:43.851728 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631d428-bf1f-4f27-b91f-dc5ffa73e5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:43.852000 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631d428-bf1f-4f27-b91f-dc5ffa73e5c8 None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:43.852618 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631d428-bf1f-4f27-b91f-dc5ffa73e5c8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:51:43.852920 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631d428-bf1f-4f27-b91f-dc5ffa73e5c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:43.854282 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631d428-bf1f-4f27-b91f-dc5ffa73e5c8 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:43.858993 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 413/820] 10.222.0.121 () {56 vars in 1117 bytes} [Fri Aug 26 00:51:43 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:51:43.864950 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a60a2f-88ef-4fc7-ac86-d79956f2a936 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:43.884640 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:43.967887 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a60a2f-88ef-4fc7-ac86-d79956f2a936 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:44.003296 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cfb80-48cb-4d42-8d22-6abcc7c28540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:44.003952 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cfb80-48cb-4d42-8d22-6abcc7c28540 None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:44.004161 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cfb80-48cb-4d42-8d22-6abcc7c28540 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:44.004431 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cfb80-48cb-4d42-8d22-6abcc7c28540 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:44.005095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cfb80-48cb-4d42-8d22-6abcc7c28540 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:44.006477 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cfb80-48cb-4d42-8d22-6abcc7c28540 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:44.142015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 408/821] 10.222.0.121 () {60 vars in 1149 bytes} [Fri Aug 26 00:51:43 2022] POST /identity/v3/endpoints => generated 336 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:51:53.856571 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=54 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:54.137764 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=62,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:12.199116 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95803eea-d68d-41eb-bb9b-77834ae487a7 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:12.199762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95803eea-d68d-41eb-bb9b-77834ae487a7 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:12.199762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95803eea-d68d-41eb-bb9b-77834ae487a7 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:12.201086 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 414/822] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:53:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:53:12.206570 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70565f0b-a854-4d06-8629-0377ca191693 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:12.207028 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70565f0b-a854-4d06-8629-0377ca191693 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:12.207124 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70565f0b-a854-4d06-8629-0377ca191693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:12.231594 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-70565f0b-a854-4d06-8629-0377ca191693 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:12.233342 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-70565f0b-a854-4d06-8629-0377ca191693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:12.312115 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 409/823] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:53:12 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:53:12.648571 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95803eea-d68d-41eb-bb9b-77834ae487a7 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:12.769680 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95803eea-d68d-41eb-bb9b-77834ae487a7 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:12.805338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664eabb-f720-4129-9e26-a972cc1319ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:12.805993 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664eabb-f720-4129-9e26-a972cc1319ec None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:12.806270 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664eabb-f720-4129-9e26-a972cc1319ec None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:12.806546 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664eabb-f720-4129-9e26-a972cc1319ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:12.817425 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664eabb-f720-4129-9e26-a972cc1319ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:12.818989 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664eabb-f720-4129-9e26-a972cc1319ec None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-d664eabb-f720-4129-9e26-a972cc1319ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:53:12.833848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:12.842046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:53:12.843273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:53:12.843273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:12.843273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:12.843273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 415/824] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:12.843570 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70565f0b-a854-4d06-8629-0377ca191693 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:12.945443 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70565f0b-a854-4d06-8629-0377ca191693 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:12.972224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:12.980736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b87d8f-3e2c-420d-a036-14c8d6117102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:12.981338 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b87d8f-3e2c-420d-a036-14c8d6117102 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:12.981611 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b87d8f-3e2c-420d-a036-14c8d6117102 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:12.981876 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b87d8f-3e2c-420d-a036-14c8d6117102 None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:12.982509 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b87d8f-3e2c-420d-a036-14c8d6117102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:12.982811 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b87d8f-3e2c-420d-a036-14c8d6117102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:12.984210 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b87d8f-3e2c-420d-a036-14c8d6117102 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:12.995731 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 410/825] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:53:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:13.001479 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664eabb-f720-4129-9e26-a972cc1319ec None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:13.056639 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:13.103182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664eabb-f720-4129-9e26-a972cc1319ec None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:13.136567 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323e0a5-ccd6-460b-93a9-77cf9872e7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:13.137192 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323e0a5-ccd6-460b-93a9-77cf9872e7f3 None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:13.137468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323e0a5-ccd6-460b-93a9-77cf9872e7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:13.137737 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323e0a5-ccd6-460b-93a9-77cf9872e7f3 None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:13.138381 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323e0a5-ccd6-460b-93a9-77cf9872e7f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:13.139823 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323e0a5-ccd6-460b-93a9-77cf9872e7f3 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:13.306496 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 416/826] 10.222.0.121 () {60 vars in 1137 bytes} [Fri Aug 26 00:53:13 2022] POST /identity/v3/users => generated 252 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:53:15.562823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69b5d7-bfda-43fc-8f57-da43afddeed5 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:15.563337 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69b5d7-bfda-43fc-8f57-da43afddeed5 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:15.563449 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69b5d7-bfda-43fc-8f57-da43afddeed5 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:15.565017 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 411/827] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:53:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:53:15.570305 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105eeae-6079-4ef8-a602-c51ff4f20e71 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:15.570726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105eeae-6079-4ef8-a602-c51ff4f20e71 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:15.570873 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105eeae-6079-4ef8-a602-c51ff4f20e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:15.589422 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-7105eeae-6079-4ef8-a602-c51ff4f20e71 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:15.590629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-7105eeae-6079-4ef8-a602-c51ff4f20e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:15.656762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 417/828] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:53:15 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:53:15.999156 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69b5d7-bfda-43fc-8f57-da43afddeed5 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:16.108804 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69b5d7-bfda-43fc-8f57-da43afddeed5 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:16.144424 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba32a07-b336-416d-93fb-125e191e6855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:16.145072 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32a07-b336-416d-93fb-125e191e6855 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:16.145352 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32a07-b336-416d-93fb-125e191e6855 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:16.145626 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32a07-b336-416d-93fb-125e191e6855 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:16.157466 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba32a07-b336-416d-93fb-125e191e6855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-dba32a07-b336-416d-93fb-125e191e6855 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:53:16.162755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:16.173082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:16.174150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:16.174150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:16.174150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:16.174150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:16.174150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:53:16.174150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:53:16.174150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:53:16.174150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:53:16.174150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:53:16.174150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:53:16.174150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:53:16.174150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:16.174150 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 412/829] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:53:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:16.175589 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105eeae-6079-4ef8-a602-c51ff4f20e71 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:16.210399 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:16.268774 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105eeae-6079-4ef8-a602-c51ff4f20e71 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:16.304855 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747352ad-f221-42e0-b733-6216ea43bc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:16.305467 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747352ad-f221-42e0-b733-6216ea43bc6f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:16.305745 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747352ad-f221-42e0-b733-6216ea43bc6f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:16.306016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747352ad-f221-42e0-b733-6216ea43bc6f None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:16.306674 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747352ad-f221-42e0-b733-6216ea43bc6f None admin] RBAC: Adding query filter params (name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:16.307124 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747352ad-f221-42e0-b733-6216ea43bc6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:16.308379 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747352ad-f221-42e0-b733-6216ea43bc6f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:16.316940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 418/830] 10.222.0.121 () {56 vars in 1108 bytes} [Fri Aug 26 00:53:16 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:16.322769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba32a07-b336-416d-93fb-125e191e6855 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:16.373234 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:16.436108 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba32a07-b336-416d-93fb-125e191e6855 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:16.471190 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b243d-1bf3-423c-9c42-cbe26812374b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:16.472338 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b243d-1bf3-423c-9c42-cbe26812374b None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:16.472610 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b243d-1bf3-423c-9c42-cbe26812374b None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:16.472880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b243d-1bf3-423c-9c42-cbe26812374b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:16.484514 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b243d-1bf3-423c-9c42-cbe26812374b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:16.486077 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b243d-1bf3-423c-9c42-cbe26812374b None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-165b243d-1bf3-423c-9c42-cbe26812374b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:53:16.500726 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:16.501775 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:53:16.502717 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:53:16.502717 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:16.502717 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:16.502717 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 413/831] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:16.508895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747352ad-f221-42e0-b733-6216ea43bc6f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:16.613772 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:16.617464 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747352ad-f221-42e0-b733-6216ea43bc6f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:16.652619 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f00a3-6360-440b-92dc-ca1e23795b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:16.653210 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f00a3-6360-440b-92dc-ca1e23795b5f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:16.653487 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f00a3-6360-440b-92dc-ca1e23795b5f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:16.653769 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f00a3-6360-440b-92dc-ca1e23795b5f None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:16.654408 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f00a3-6360-440b-92dc-ca1e23795b5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:16.654721 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f00a3-6360-440b-92dc-ca1e23795b5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:16.657178 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f00a3-6360-440b-92dc-ca1e23795b5f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:16.670623 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 419/832] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:53:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:53:16.676486 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b243d-1bf3-423c-9c42-cbe26812374b None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:16.779569 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:16.783376 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b243d-1bf3-423c-9c42-cbe26812374b None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:16.818783 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822879c-cdf6-45cd-870c-ac0f7626dc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:16.819455 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822879c-cdf6-45cd-870c-ac0f7626dc23 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:16.819791 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822879c-cdf6-45cd-870c-ac0f7626dc23 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:16.820005 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822879c-cdf6-45cd-870c-ac0f7626dc23 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:16.828061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822879c-cdf6-45cd-870c-ac0f7626dc23 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:16.829544 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822879c-cdf6-45cd-870c-ac0f7626dc23 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-9822879c-cdf6-45cd-870c-ac0f7626dc23 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:53:16.842137 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:16.843383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:16.844498 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:16.844498 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:16.844498 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:53:16.844498 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:53:16.844498 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:53:16.844498 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:53:16.844498 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:53:16.844498 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:53:16.844498 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:53:16.844498 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:16.844498 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 414/833] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:16.850331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f00a3-6360-440b-92dc-ca1e23795b5f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:16.988211 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f00a3-6360-440b-92dc-ca1e23795b5f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:17.050679 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960e12d-5f26-44a5-b624-7c52a4fea7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:17.051476 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960e12d-5f26-44a5-b624-7c52a4fea7a0 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:17.051840 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960e12d-5f26-44a5-b624-7c52a4fea7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:17.052417 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960e12d-5f26-44a5-b624-7c52a4fea7a0 None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:17.053361 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960e12d-5f26-44a5-b624-7c52a4fea7a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:17.053674 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960e12d-5f26-44a5-b624-7c52a4fea7a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:17.055488 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960e12d-5f26-44a5-b624-7c52a4fea7a0 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:17.076508 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 420/834] 10.222.0.121 () {56 vars in 1148 bytes} [Fri Aug 26 00:53:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:53:17.082417 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822879c-cdf6-45cd-870c-ac0f7626dc23 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:17.190485 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822879c-cdf6-45cd-870c-ac0f7626dc23 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:17.225679 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3cb9d-9698-41a8-8a3b-49d85865e42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:17.226295 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3cb9d-9698-41a8-8a3b-49d85865e42d None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:17.226576 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3cb9d-9698-41a8-8a3b-49d85865e42d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:17.226868 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3cb9d-9698-41a8-8a3b-49d85865e42d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:17.254244 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:17.293686 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3cb9d-9698-41a8-8a3b-49d85865e42d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:17.295248 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3cb9d-9698-41a8-8a3b-49d85865e42d None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:17.410941 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 415/835] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:53:17 2022] GET /identity/v3/auth/tokens => generated 1873 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:53:17.416857 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960e12d-5f26-44a5-b624-7c52a4fea7a0 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:17.436282 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:17.516450 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960e12d-5f26-44a5-b624-7c52a4fea7a0 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:17.551176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b71bd-a523-4f48-84c9-06eba0f409f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:17.551806 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b71bd-a523-4f48-84c9-06eba0f409f9 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:17.552086 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b71bd-a523-4f48-84c9-06eba0f409f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:17.552359 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b71bd-a523-4f48-84c9-06eba0f409f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:17.562295 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b71bd-a523-4f48-84c9-06eba0f409f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:17.564046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b71bd-a523-4f48-84c9-06eba0f409f9 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-f27b71bd-a523-4f48-84c9-06eba0f409f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:53:17.579695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:17.580930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:53:17.581837 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:53:17.581837 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:17.581837 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:17.581837 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 421/836] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:17.586683 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3cb9d-9698-41a8-8a3b-49d85865e42d None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:17.648228 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:17.693525 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3cb9d-9698-41a8-8a3b-49d85865e42d None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:17.730001 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc97bd-0857-427a-b638-1700c6267604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:17.730659 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc97bd-0857-427a-b638-1700c6267604 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:17.730968 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc97bd-0857-427a-b638-1700c6267604 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:17.731244 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc97bd-0857-427a-b638-1700c6267604 None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:17.731911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc97bd-0857-427a-b638-1700c6267604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:17.732246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc97bd-0857-427a-b638-1700c6267604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:17.733629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc97bd-0857-427a-b638-1700c6267604 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:17.746054 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 416/837] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:53:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:17.751913 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b71bd-a523-4f48-84c9-06eba0f409f9 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:17.826091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:17.862880 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b71bd-a523-4f48-84c9-06eba0f409f9 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:17.897716 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e951ac9-3e41-42cf-a98a-41715a2d7710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:17.898359 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e951ac9-3e41-42cf-a98a-41715a2d7710 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:17.898631 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e951ac9-3e41-42cf-a98a-41715a2d7710 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:17.898939 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e951ac9-3e41-42cf-a98a-41715a2d7710 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:17.905755 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e951ac9-3e41-42cf-a98a-41715a2d7710 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:17.907243 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e951ac9-3e41-42cf-a98a-41715a2d7710 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:17.919457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-2e951ac9-3e41-42cf-a98a-41715a2d7710 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:53:17.919457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:17.919457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:17.919457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:17.919457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:17.919457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:17.919457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:17.919457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:17.919457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:17.919457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:17.919457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:17.919457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:17.919457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:53:17.919457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:53:17.919457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:17.920605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:17.921736 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:53:17.921736 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:53:17.921736 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:53:17.921736 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:53:17.921736 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:53:17.921736 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:53:17.921736 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:53:17.921736 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:17.921736 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 422/838] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:53:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:17.927323 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc97bd-0857-427a-b638-1700c6267604 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:18.035788 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc97bd-0857-427a-b638-1700c6267604 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:18.055546 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:18.075104 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65b1ab-7faa-4e28-a6ee-87e270e20d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:18.075729 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65b1ab-7faa-4e28-a6ee-87e270e20d33 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:18.076002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65b1ab-7faa-4e28-a6ee-87e270e20d33 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:18.076353 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65b1ab-7faa-4e28-a6ee-87e270e20d33 None admin] PATH_INFO: `/v3/projects` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:18.076981 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65b1ab-7faa-4e28-a6ee-87e270e20d33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:18.077283 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65b1ab-7faa-4e28-a6ee-87e270e20d33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:18.078751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65b1ab-7faa-4e28-a6ee-87e270e20d33 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:18.092639 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 417/839] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:53:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:18.099271 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e951ac9-3e41-42cf-a98a-41715a2d7710 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:18.207369 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e951ac9-3e41-42cf-a98a-41715a2d7710 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:18.235684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:18.242035 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40edc3-0d71-4012-b5e0-3f98ec08d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:18.242638 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40edc3-0d71-4012-b5e0-3f98ec08d152 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:18.242947 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40edc3-0d71-4012-b5e0-3f98ec08d152 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:18.243221 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40edc3-0d71-4012-b5e0-3f98ec08d152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:18.243941 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40edc3-0d71-4012-b5e0-3f98ec08d152 None admin] RBAC: Adding query filter params (role.id=7b8b39bfefe4416cab4e766c2cdb6006, scope.project.id=c6af527bb8974bc6915553d99df0901e, user.id=49070d8a078644f4a9e17deab052ba41) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:18.244252 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40edc3-0d71-4012-b5e0-3f98ec08d152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:18.245686 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40edc3-0d71-4012-b5e0-3f98ec08d152 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:18.251064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 423/840] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:53:18 2022] GET /identity/v3/role_assignments?user.id=49070d8a078644f4a9e17deab052ba41&scope.project.id=c6af527bb8974bc6915553d99df0901e&role.id=7b8b39bfefe4416cab4e766c2cdb6006 => generated 260 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:20.446238 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f9475-5fe6-41bb-8dd4-a7dfff8cdbe9 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:20.446764 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f9475-5fe6-41bb-8dd4-a7dfff8cdbe9 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:20.446764 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f9475-5fe6-41bb-8dd4-a7dfff8cdbe9 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:20.448149 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 418/841] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:53:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:53:20.453461 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dada3a-bee3-4c21-b76b-7b62c10c64a9 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:20.453867 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dada3a-bee3-4c21-b76b-7b62c10c64a9 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:20.454021 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dada3a-bee3-4c21-b76b-7b62c10c64a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:20.473046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-72dada3a-bee3-4c21-b76b-7b62c10c64a9 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:20.474311 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-72dada3a-bee3-4c21-b76b-7b62c10c64a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:20.545881 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 424/842] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:53:20 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:53:20.879970 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f9475-5fe6-41bb-8dd4-a7dfff8cdbe9 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:20.982605 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f9475-5fe6-41bb-8dd4-a7dfff8cdbe9 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:21.017513 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7a816-0981-41bf-9731-b63c0c2d4302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:21.018159 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7a816-0981-41bf-9731-b63c0c2d4302 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:21.018434 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7a816-0981-41bf-9731-b63c0c2d4302 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:21.018711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7a816-0981-41bf-9731-b63c0c2d4302 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:21.030880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7a816-0981-41bf-9731-b63c0c2d4302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-07c7a816-0981-41bf-9731-b63c0c2d4302 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:53:21.039926 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:21.041068 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:21.041922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:21.041922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:21.041922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:21.041922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:21.041922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:53:21.041922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:53:21.041922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:53:21.041922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:53:21.041922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:53:21.041922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:53:21.041922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:53:21.041922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:21.041922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 419/843] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:53:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:21.048004 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dada3a-bee3-4c21-b76b-7b62c10c64a9 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:21.146956 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dada3a-bee3-4c21-b76b-7b62c10c64a9 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:21.171850 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:21.182781 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568461d-b9ac-47b9-9b43-3e126916c579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:21.183551 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568461d-b9ac-47b9-9b43-3e126916c579 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:21.183835 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568461d-b9ac-47b9-9b43-3e126916c579 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:21.184109 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568461d-b9ac-47b9-9b43-3e126916c579 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:21.184767 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568461d-b9ac-47b9-9b43-3e126916c579 None admin] RBAC: Adding query filter params (name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:21.185096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568461d-b9ac-47b9-9b43-3e126916c579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:21.186445 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568461d-b9ac-47b9-9b43-3e126916c579 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:21.195305 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 425/844] 10.222.0.121 () {56 vars in 1108 bytes} [Fri Aug 26 00:53:21 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:21.201181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7a816-0981-41bf-9731-b63c0c2d4302 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:21.242300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:21.303753 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7a816-0981-41bf-9731-b63c0c2d4302 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:21.342231 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894edd3-b3d9-41e0-80d2-1c20d0e77cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:21.342879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894edd3-b3d9-41e0-80d2-1c20d0e77cb1 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:21.343182 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894edd3-b3d9-41e0-80d2-1c20d0e77cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:21.343432 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894edd3-b3d9-41e0-80d2-1c20d0e77cb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:21.353838 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894edd3-b3d9-41e0-80d2-1c20d0e77cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:21.355319 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894edd3-b3d9-41e0-80d2-1c20d0e77cb1 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-8894edd3-b3d9-41e0-80d2-1c20d0e77cb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:53:21.369674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:21.370628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:53:21.371561 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:53:21.371561 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:21.371561 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:21.371561 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 420/845] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:21.376649 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568461d-b9ac-47b9-9b43-3e126916c579 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:21.481629 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568461d-b9ac-47b9-9b43-3e126916c579 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:21.518274 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1f850-f8fa-49e1-b659-9b9ab7b50bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:21.518982 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f850-f8fa-49e1-b659-9b9ab7b50bcf None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:21.519252 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f850-f8fa-49e1-b659-9b9ab7b50bcf None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:21.519524 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f850-f8fa-49e1-b659-9b9ab7b50bcf None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:21.520161 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1f850-f8fa-49e1-b659-9b9ab7b50bcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:21.520461 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1f850-f8fa-49e1-b659-9b9ab7b50bcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:21.521825 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1f850-f8fa-49e1-b659-9b9ab7b50bcf None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:21.534311 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 426/846] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:53:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:21.541752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894edd3-b3d9-41e0-80d2-1c20d0e77cb1 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:21.638523 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:21.648148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894edd3-b3d9-41e0-80d2-1c20d0e77cb1 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:21.682062 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67a47b-8463-4638-a6b7-3994d67690d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:21.682693 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67a47b-8463-4638-a6b7-3994d67690d9 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:21.683011 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67a47b-8463-4638-a6b7-3994d67690d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:21.683320 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67a47b-8463-4638-a6b7-3994d67690d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:21.691161 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67a47b-8463-4638-a6b7-3994d67690d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:21.692664 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67a47b-8463-4638-a6b7-3994d67690d9 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-4b67a47b-8463-4638-a6b7-3994d67690d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:53:21.703572 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:21.704749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:21.706504 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:21.706504 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:21.706504 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:53:21.706504 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:53:21.706504 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:53:21.706504 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:53:21.706504 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:53:21.706504 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:53:21.706504 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:53:21.706504 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:21.706504 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 421/847] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:21.711804 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1f850-f8fa-49e1-b659-9b9ab7b50bcf None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:21.760034 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:21.814427 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1f850-f8fa-49e1-b659-9b9ab7b50bcf None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:21.849459 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2596794-8819-4564-afdf-4355f62ea352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:21.850226 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2596794-8819-4564-afdf-4355f62ea352 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:21.850501 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2596794-8819-4564-afdf-4355f62ea352 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:21.850778 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2596794-8819-4564-afdf-4355f62ea352 None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:21.851537 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2596794-8819-4564-afdf-4355f62ea352 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:21.851837 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2596794-8819-4564-afdf-4355f62ea352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:21.853273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2596794-8819-4564-afdf-4355f62ea352 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:21.871581 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 427/848] 10.222.0.121 () {56 vars in 1148 bytes} [Fri Aug 26 00:53:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:21.877527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67a47b-8463-4638-a6b7-3994d67690d9 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:21.978380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67a47b-8463-4638-a6b7-3994d67690d9 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:22.020226 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68fb63-0e67-4d29-a957-b35a341b96b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:22.020767 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68fb63-0e67-4d29-a957-b35a341b96b7 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:22.021045 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68fb63-0e67-4d29-a957-b35a341b96b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:22.021316 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68fb63-0e67-4d29-a957-b35a341b96b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:22.031796 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68fb63-0e67-4d29-a957-b35a341b96b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:22.033259 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68fb63-0e67-4d29-a957-b35a341b96b7 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-dd68fb63-0e67-4d29-a957-b35a341b96b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:53:22.049642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:22.050989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:53:22.052052 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:53:22.052052 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:22.052052 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:22.052052 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 422/849] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:22.057561 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2596794-8819-4564-afdf-4355f62ea352 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:22.167550 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2596794-8819-4564-afdf-4355f62ea352 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:22.170274 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:22.215694 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f240e-5d4f-4b9d-bc7e-4dfae01b1f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:22.216297 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f240e-5d4f-4b9d-bc7e-4dfae01b1f3f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:22.216570 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f240e-5d4f-4b9d-bc7e-4dfae01b1f3f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:22.216836 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f240e-5d4f-4b9d-bc7e-4dfae01b1f3f None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:22.217518 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f240e-5d4f-4b9d-bc7e-4dfae01b1f3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:22.217810 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f240e-5d4f-4b9d-bc7e-4dfae01b1f3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:22.219207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f240e-5d4f-4b9d-bc7e-4dfae01b1f3f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:22.231152 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 428/850] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:53:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:22.240031 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68fb63-0e67-4d29-a957-b35a341b96b7 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:22.243300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:22.352941 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68fb63-0e67-4d29-a957-b35a341b96b7 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:22.387242 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6ea0-839e-4829-a256-af319f630fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:22.387937 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6ea0-839e-4829-a256-af319f630fe6 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:22.388922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6ea0-839e-4829-a256-af319f630fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:22.389195 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6ea0-839e-4829-a256-af319f630fe6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:22.397022 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a6ea0-839e-4829-a256-af319f630fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:22.398614 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a6ea0-839e-4829-a256-af319f630fe6 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:22.409751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-ec0a6ea0-839e-4829-a256-af319f630fe6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:53:22.409751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:22.409751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:22.409751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:22.409751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:22.409751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:22.409751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:22.409751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:22.409751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:22.409751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:22.409751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:22.409751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:22.409751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:53:22.409751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:53:22.409751 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:22.410847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:22.411770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:53:22.411770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:53:22.411770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:53:22.411770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:53:22.411770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:53:22.411770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:53:22.411770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:53:22.411770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:22.411770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 423/851] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:53:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:22.417001 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f240e-5d4f-4b9d-bc7e-4dfae01b1f3f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:22.531820 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f240e-5d4f-4b9d-bc7e-4dfae01b1f3f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:22.568721 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be1d0b-4faf-4869-8ac9-000baf1df875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:22.569243 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1d0b-4faf-4869-8ac9-000baf1df875 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:22.569534 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1d0b-4faf-4869-8ac9-000baf1df875 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:22.569848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1d0b-4faf-4869-8ac9-000baf1df875 None admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:22.570506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be1d0b-4faf-4869-8ac9-000baf1df875 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:22.570808 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be1d0b-4faf-4869-8ac9-000baf1df875 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:22.572258 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be1d0b-4faf-4869-8ac9-000baf1df875 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:22.586564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 429/852] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:22.592906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6ea0-839e-4829-a256-af319f630fe6 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:22.665854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:22.712309 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6ea0-839e-4829-a256-af319f630fe6 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:22.749478 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf4078-e051-4e7e-aba0-ed01ac3fb0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:22.750238 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4078-e051-4e7e-aba0-ed01ac3fb0a3 None admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:22.750515 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4078-e051-4e7e-aba0-ed01ac3fb0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:22.750785 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4078-e051-4e7e-aba0-ed01ac3fb0a3 None admin] PATH_INFO: `/v3/projects/c6af527bb8974bc6915553d99df0901e/users/49070d8a078644f4a9e17deab052ba41/roles/7b8b39bfefe4416cab4e766c2cdb6006` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:22.766090 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf4078-e051-4e7e-aba0-ed01ac3fb0a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6af527bb8974bc6915553d99df0901e, user_id=49070d8a078644f4a9e17deab052ba41, role_id=7b8b39bfefe4416cab4e766c2cdb6006)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:22.771640 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf4078-e051-4e7e-aba0-ed01ac3fb0a3 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:22.928790 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 424/853] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:53:22 2022] PUT /identity/v3/projects/c6af527bb8974bc6915553d99df0901e/users/49070d8a078644f4a9e17deab052ba41/roles/7b8b39bfefe4416cab4e766c2cdb6006 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:53:25.145503 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ac72d-06cd-4434-b15f-b69bf2a0a02a None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:25.146034 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ac72d-06cd-4434-b15f-b69bf2a0a02a None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:25.146119 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ac72d-06cd-4434-b15f-b69bf2a0a02a None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:25.147462 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 430/854] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:53:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:53:25.153337 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d695411-d012-4dd9-a2e9-c03fa26c11f8 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:25.153837 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d695411-d012-4dd9-a2e9-c03fa26c11f8 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:25.153929 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d695411-d012-4dd9-a2e9-c03fa26c11f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:25.172089 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-1d695411-d012-4dd9-a2e9-c03fa26c11f8 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:25.173307 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-1d695411-d012-4dd9-a2e9-c03fa26c11f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:25.242233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 425/855] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:53:25 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:53:25.575979 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ac72d-06cd-4434-b15f-b69bf2a0a02a None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:25.601848 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:25.677601 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ac72d-06cd-4434-b15f-b69bf2a0a02a None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:25.710913 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b14a33-c5d9-4825-9b53-fe4def60fa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:25.711361 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b14a33-c5d9-4825-9b53-fe4def60fa70 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:25.711638 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b14a33-c5d9-4825-9b53-fe4def60fa70 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:25.711899 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b14a33-c5d9-4825-9b53-fe4def60fa70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:25.721887 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b14a33-c5d9-4825-9b53-fe4def60fa70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-73b14a33-c5d9-4825-9b53-fe4def60fa70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:53:25.726523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:25.727665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:25.728540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:25.728540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:25.728540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:25.728540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:25.728540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:53:25.728540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:53:25.728540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:53:25.728540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:53:25.728540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:53:25.728540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:53:25.728540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:53:25.728540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:25.728540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 431/856] 10.222.0.121 () {56 vars in 1107 bytes} [Fri Aug 26 00:53:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:25.734213 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d695411-d012-4dd9-a2e9-c03fa26c11f8 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:25.778241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:25.839550 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d695411-d012-4dd9-a2e9-c03fa26c11f8 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:25.875316 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b504be-3752-44b1-9764-1772d44d4ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:25.875914 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b504be-3752-44b1-9764-1772d44d4ef8 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:25.876190 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b504be-3752-44b1-9764-1772d44d4ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:25.876462 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b504be-3752-44b1-9764-1772d44d4ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:25.877138 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b504be-3752-44b1-9764-1772d44d4ef8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:25.877438 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b504be-3752-44b1-9764-1772d44d4ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:25.878812 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b504be-3752-44b1-9764-1772d44d4ef8 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:25.886559 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 426/857] 10.222.0.121 () {56 vars in 1108 bytes} [Fri Aug 26 00:53:25 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:25.892710 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b14a33-c5d9-4825-9b53-fe4def60fa70 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:25.979147 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:25.997740 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b14a33-c5d9-4825-9b53-fe4def60fa70 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:26.036045 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283085d3-d0fa-4423-a425-226a93cc3aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:26.036675 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283085d3-d0fa-4423-a425-226a93cc3aaa None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:26.036949 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283085d3-d0fa-4423-a425-226a93cc3aaa None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:26.037218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283085d3-d0fa-4423-a425-226a93cc3aaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:26.048151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283085d3-d0fa-4423-a425-226a93cc3aaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:26.050217 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283085d3-d0fa-4423-a425-226a93cc3aaa None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-283085d3-d0fa-4423-a425-226a93cc3aaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:53:26.064471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:26.070186 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:53:26.073717 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:53:26.073717 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:26.073717 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:26.073717 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 432/858] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:26.073960 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b504be-3752-44b1-9764-1772d44d4ef8 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:26.181293 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b504be-3752-44b1-9764-1772d44d4ef8 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:26.183552 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:26.214747 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c6571-412f-4ffa-bff6-c0ed46a18913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:26.215378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c6571-412f-4ffa-bff6-c0ed46a18913 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:26.215657 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c6571-412f-4ffa-bff6-c0ed46a18913 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:26.215929 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c6571-412f-4ffa-bff6-c0ed46a18913 None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:26.216558 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c6571-412f-4ffa-bff6-c0ed46a18913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:26.216859 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c6571-412f-4ffa-bff6-c0ed46a18913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:26.218241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c6571-412f-4ffa-bff6-c0ed46a18913 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:26.230367 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 427/859] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:53:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:53:26.236196 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283085d3-d0fa-4423-a425-226a93cc3aaa None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:26.346008 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283085d3-d0fa-4423-a425-226a93cc3aaa None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:26.381002 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea55fbe-5fb1-446d-be5f-f67305a162c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:26.381630 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea55fbe-5fb1-446d-be5f-f67305a162c7 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:26.381903 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea55fbe-5fb1-446d-be5f-f67305a162c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:26.382172 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea55fbe-5fb1-446d-be5f-f67305a162c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:26.385006 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:26.390352 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea55fbe-5fb1-446d-be5f-f67305a162c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:26.391838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea55fbe-5fb1-446d-be5f-f67305a162c7 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-dea55fbe-5fb1-446d-be5f-f67305a162c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:53:26.403495 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:26.404702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:26.405695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:26.405695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:26.405695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:53:26.405695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:53:26.405695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:53:26.405695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:53:26.405695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:53:26.405695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:53:26.405695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:53:26.405695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:26.405695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 433/860] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:26.411336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c6571-412f-4ffa-bff6-c0ed46a18913 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:26.522595 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c6571-412f-4ffa-bff6-c0ed46a18913 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:26.558497 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601b29c-616c-4e3f-9117-f8e04c3e390e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:26.559132 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601b29c-616c-4e3f-9117-f8e04c3e390e None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:26.559406 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601b29c-616c-4e3f-9117-f8e04c3e390e None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:26.559676 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601b29c-616c-4e3f-9117-f8e04c3e390e None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:26.560394 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601b29c-616c-4e3f-9117-f8e04c3e390e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:26.560707 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601b29c-616c-4e3f-9117-f8e04c3e390e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:26.562183 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601b29c-616c-4e3f-9117-f8e04c3e390e None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:26.580205 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 428/861] 10.222.0.121 () {56 vars in 1148 bytes} [Fri Aug 26 00:53:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:26.587076 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea55fbe-5fb1-446d-be5f-f67305a162c7 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:26.687505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea55fbe-5fb1-446d-be5f-f67305a162c7 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:26.722276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b8042-67a5-4804-b107-2cdbb502d7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:26.722901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b8042-67a5-4804-b107-2cdbb502d7eb None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:26.723181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b8042-67a5-4804-b107-2cdbb502d7eb None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:26.723449 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b8042-67a5-4804-b107-2cdbb502d7eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:26.787732 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:26.798989 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b8042-67a5-4804-b107-2cdbb502d7eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:26.800467 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b8042-67a5-4804-b107-2cdbb502d7eb None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:26.905711 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 434/862] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:53:26 2022] GET /identity/v3/auth/tokens => generated 1873 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:53:26.911657 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601b29c-616c-4e3f-9117-f8e04c3e390e None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:26.937566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:27.016992 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601b29c-616c-4e3f-9117-f8e04c3e390e None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:27.053598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f89bd-dacb-4bce-a2c5-b54bff82e0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:27.054169 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f89bd-dacb-4bce-a2c5-b54bff82e0be None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:27.054451 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f89bd-dacb-4bce-a2c5-b54bff82e0be None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:27.054724 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f89bd-dacb-4bce-a2c5-b54bff82e0be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:27.066241 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f89bd-dacb-4bce-a2c5-b54bff82e0be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:27.068609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f89bd-dacb-4bce-a2c5-b54bff82e0be None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-2c5f89bd-dacb-4bce-a2c5-b54bff82e0be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:53:27.082910 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:27.084116 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:53:27.085352 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:53:27.085352 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:27.085352 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:27.085352 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 429/863] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:27.089811 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b8042-67a5-4804-b107-2cdbb502d7eb None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:27.184965 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:27.191747 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b8042-67a5-4804-b107-2cdbb502d7eb None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:27.228587 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbaa19-4aa9-43cc-896a-7fdeb4b22c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:27.229201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbaa19-4aa9-43cc-896a-7fdeb4b22c0f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:27.229481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbaa19-4aa9-43cc-896a-7fdeb4b22c0f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:27.229753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbaa19-4aa9-43cc-896a-7fdeb4b22c0f None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:27.230398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbaa19-4aa9-43cc-896a-7fdeb4b22c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:27.230701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbaa19-4aa9-43cc-896a-7fdeb4b22c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:27.232114 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbaa19-4aa9-43cc-896a-7fdeb4b22c0f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:27.244908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 435/864] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:53:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:27.250980 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f89bd-dacb-4bce-a2c5-b54bff82e0be None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:27.335336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:27.363235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f89bd-dacb-4bce-a2c5-b54bff82e0be None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:27.399037 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e4b9c-4120-40e0-8fa8-69fe554a25a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:27.399452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e4b9c-4120-40e0-8fa8-69fe554a25a1 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:27.399730 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e4b9c-4120-40e0-8fa8-69fe554a25a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:27.400002 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e4b9c-4120-40e0-8fa8-69fe554a25a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:27.408217 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e4b9c-4120-40e0-8fa8-69fe554a25a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:27.410352 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e4b9c-4120-40e0-8fa8-69fe554a25a1 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:27.423439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-810e4b9c-4120-40e0-8fa8-69fe554a25a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:53:27.423439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:27.423439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:27.423439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:27.423439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:27.423439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:27.423439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:27.423439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:27.423439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:27.423439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:27.423439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:27.423439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:27.423439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:53:27.423439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:53:27.423439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:27.425133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:27.426300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:53:27.426300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:53:27.426300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:53:27.426300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:53:27.426300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:53:27.426300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:53:27.426300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:53:27.426300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:27.426300 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 430/865] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:27.433262 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbaa19-4aa9-43cc-896a-7fdeb4b22c0f None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:27.542264 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbaa19-4aa9-43cc-896a-7fdeb4b22c0f None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:27.578455 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798749d0-130a-45b0-b843-cd4b5762a173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:27.578999 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798749d0-130a-45b0-b843-cd4b5762a173 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:27.579284 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798749d0-130a-45b0-b843-cd4b5762a173 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:27.579572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798749d0-130a-45b0-b843-cd4b5762a173 None admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:27.580295 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798749d0-130a-45b0-b843-cd4b5762a173 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:27.580605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798749d0-130a-45b0-b843-cd4b5762a173 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:27.582053 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798749d0-130a-45b0-b843-cd4b5762a173 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:27.595566 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 436/866] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:27.603344 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e4b9c-4120-40e0-8fa8-69fe554a25a1 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:27.721986 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e4b9c-4120-40e0-8fa8-69fe554a25a1 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:27.759031 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab2cc1-e374-4a4f-8eb8-32df4c8164e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:27.759625 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab2cc1-e374-4a4f-8eb8-32df4c8164e8 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:27.759901 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab2cc1-e374-4a4f-8eb8-32df4c8164e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:27.760169 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab2cc1-e374-4a4f-8eb8-32df4c8164e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:27.760890 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab2cc1-e374-4a4f-8eb8-32df4c8164e8 None admin] RBAC: Adding query filter params (role.id=7b8b39bfefe4416cab4e766c2cdb6006, scope.project.id=c6af527bb8974bc6915553d99df0901e, user.id=49070d8a078644f4a9e17deab052ba41) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:27.761196 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab2cc1-e374-4a4f-8eb8-32df4c8164e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:27.762637 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab2cc1-e374-4a4f-8eb8-32df4c8164e8 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:27.764577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:27.770109 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 431/867] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:53:27 2022] GET /identity/v3/role_assignments?user.id=49070d8a078644f4a9e17deab052ba41&scope.project.id=c6af527bb8974bc6915553d99df0901e&role.id=7b8b39bfefe4416cab4e766c2cdb6006 => generated 610 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:30.073322 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e15e6c-1584-4da7-8706-ba46618aed98 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:30.073895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e15e6c-1584-4da7-8706-ba46618aed98 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:30.073895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e15e6c-1584-4da7-8706-ba46618aed98 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:30.075267 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 437/868] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:53:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:53:30.080557 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba7563-a4b0-4359-9b06-5ac933149185 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:30.080959 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba7563-a4b0-4359-9b06-5ac933149185 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:30.081109 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba7563-a4b0-4359-9b06-5ac933149185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:30.102639 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-f6ba7563-a4b0-4359-9b06-5ac933149185 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:30.103905 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-f6ba7563-a4b0-4359-9b06-5ac933149185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:30.175188 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 432/869] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:53:30 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:53:30.504250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e15e6c-1584-4da7-8706-ba46618aed98 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:30.522458 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:30.609773 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e15e6c-1584-4da7-8706-ba46618aed98 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:30.644917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b63262-ccf2-4c54-8a47-bff94a9a8057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:30.645547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63262-ccf2-4c54-8a47-bff94a9a8057 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:30.645825 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63262-ccf2-4c54-8a47-bff94a9a8057 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:30.646098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63262-ccf2-4c54-8a47-bff94a9a8057 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:30.657977 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b63262-ccf2-4c54-8a47-bff94a9a8057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-75b63262-ccf2-4c54-8a47-bff94a9a8057 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:53:30.662860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:30.664098 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:30.665179 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:30.665179 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:30.665179 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:30.665179 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:30.665179 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:53:30.665179 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:53:30.665179 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:53:30.665179 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:53:30.665179 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:53:30.665179 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:53:30.665179 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:53:30.665179 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:30.665179 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 438/870] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:53:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:30.670207 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba7563-a4b0-4359-9b06-5ac933149185 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:30.780578 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba7563-a4b0-4359-9b06-5ac933149185 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:30.807627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:30.816613 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa88b0e-a1ab-48f7-8835-12e771716205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:30.817223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88b0e-a1ab-48f7-8835-12e771716205 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:30.817599 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88b0e-a1ab-48f7-8835-12e771716205 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:30.817877 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88b0e-a1ab-48f7-8835-12e771716205 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:30.818539 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa88b0e-a1ab-48f7-8835-12e771716205 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:30.818869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa88b0e-a1ab-48f7-8835-12e771716205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:30.820256 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa88b0e-a1ab-48f7-8835-12e771716205 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:30.828646 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 433/871] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:53:30 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:30.834810 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b63262-ccf2-4c54-8a47-bff94a9a8057 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:30.915665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:30.940949 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b63262-ccf2-4c54-8a47-bff94a9a8057 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:30.982535 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010148bb-eb9d-490c-8a88-8da877545112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:30.988774 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010148bb-eb9d-490c-8a88-8da877545112 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:30.988774 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010148bb-eb9d-490c-8a88-8da877545112 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:30.988774 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010148bb-eb9d-490c-8a88-8da877545112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:30.995865 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010148bb-eb9d-490c-8a88-8da877545112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:30.997334 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010148bb-eb9d-490c-8a88-8da877545112 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-010148bb-eb9d-490c-8a88-8da877545112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:53:31.012916 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:31.013996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:53:31.014952 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:53:31.014952 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:31.014952 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:31.014952 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 439/872] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:53:31.020344 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa88b0e-a1ab-48f7-8835-12e771716205 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:31.130109 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa88b0e-a1ab-48f7-8835-12e771716205 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:31.164177 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215b197-4128-4cbe-aa08-e816ce0d5f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:31.164778 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215b197-4128-4cbe-aa08-e816ce0d5f6e None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:31.165053 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215b197-4128-4cbe-aa08-e816ce0d5f6e None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:31.165371 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215b197-4128-4cbe-aa08-e816ce0d5f6e None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:31.166418 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215b197-4128-4cbe-aa08-e816ce0d5f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:31.166628 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215b197-4128-4cbe-aa08-e816ce0d5f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:31.168048 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215b197-4128-4cbe-aa08-e816ce0d5f6e None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:31.183280 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 434/873] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:53:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:31.189452 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010148bb-eb9d-490c-8a88-8da877545112 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:31.292189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010148bb-eb9d-490c-8a88-8da877545112 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:31.319594 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:31.327281 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e4e92-3959-40d0-bd82-792ff22b75bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:31.327941 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e4e92-3959-40d0-bd82-792ff22b75bc None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:31.328269 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e4e92-3959-40d0-bd82-792ff22b75bc None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:31.328540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e4e92-3959-40d0-bd82-792ff22b75bc None admin] PATH_INFO: `/v3/users/placement` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:31.336301 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e4e92-3959-40d0-bd82-792ff22b75bc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:31.337771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e4e92-3959-40d0-bd82-792ff22b75bc None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-d03e4e92-3959-40d0-bd82-792ff22b75bc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:53:31.349684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:31.351189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:31.352416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:31.352416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:31.352416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:53:31.352416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:53:31.352416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:53:31.352416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:53:31.352416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:53:31.352416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:53:31.352416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:53:31.352416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:31.352416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 440/874] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:53:31.356973 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215b197-4128-4cbe-aa08-e816ce0d5f6e None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:31.410414 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:31.462837 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215b197-4128-4cbe-aa08-e816ce0d5f6e None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:31.498803 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61050292-ce0c-4967-9756-6077d003ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:31.499436 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61050292-ce0c-4967-9756-6077d003ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:31.499710 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61050292-ce0c-4967-9756-6077d003ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:31.499977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61050292-ce0c-4967-9756-6077d003ffc0 None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:31.500714 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61050292-ce0c-4967-9756-6077d003ffc0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:31.501019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61050292-ce0c-4967-9756-6077d003ffc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:31.502471 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61050292-ce0c-4967-9756-6077d003ffc0 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:31.522991 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 435/875] 10.222.0.121 () {56 vars in 1148 bytes} [Fri Aug 26 00:53:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:31.528957 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e4e92-3959-40d0-bd82-792ff22b75bc None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:31.638370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e4e92-3959-40d0-bd82-792ff22b75bc None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:31.689600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064f87f-a27b-4102-8a3b-5318f8c4fb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:31.689600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064f87f-a27b-4102-8a3b-5318f8c4fb9a None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:31.689600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064f87f-a27b-4102-8a3b-5318f8c4fb9a None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:31.689600 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064f87f-a27b-4102-8a3b-5318f8c4fb9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:31.735458 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:31.747784 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064f87f-a27b-4102-8a3b-5318f8c4fb9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:31.749229 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064f87f-a27b-4102-8a3b-5318f8c4fb9a None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:31.856919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 441/876] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:53:31 2022] GET /identity/v3/auth/tokens => generated 1873 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:53:31.863630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61050292-ce0c-4967-9756-6077d003ffc0 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:31.973725 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61050292-ce0c-4967-9756-6077d003ffc0 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:31.986097 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:32.014410 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e1ba9-cd34-41d4-af3a-ff43a880d044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:32.014410 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e1ba9-cd34-41d4-af3a-ff43a880d044 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:32.014410 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e1ba9-cd34-41d4-af3a-ff43a880d044 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:32.014410 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e1ba9-cd34-41d4-af3a-ff43a880d044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:32.024007 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e1ba9-cd34-41d4-af3a-ff43a880d044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:32.025488 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e1ba9-cd34-41d4-af3a-ff43a880d044 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-d55e1ba9-cd34-41d4-af3a-ff43a880d044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:53:32.040620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:32.041756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:53:32.042693 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:53:32.042693 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:32.042693 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:32.042693 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 436/877] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:32.047991 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064f87f-a27b-4102-8a3b-5318f8c4fb9a None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:32.141606 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:32.154000 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064f87f-a27b-4102-8a3b-5318f8c4fb9a None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:32.189716 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bd166-bdd4-44a3-88bc-e4ef34f028f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:32.190366 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bd166-bdd4-44a3-88bc-e4ef34f028f7 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:32.190591 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bd166-bdd4-44a3-88bc-e4ef34f028f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:32.190886 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bd166-bdd4-44a3-88bc-e4ef34f028f7 None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:32.191524 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bd166-bdd4-44a3-88bc-e4ef34f028f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:32.191826 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bd166-bdd4-44a3-88bc-e4ef34f028f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:32.193192 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bd166-bdd4-44a3-88bc-e4ef34f028f7 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:32.204578 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 442/878] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:53:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:32.210885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e1ba9-cd34-41d4-af3a-ff43a880d044 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:32.316359 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e1ba9-cd34-41d4-af3a-ff43a880d044 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:32.351452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b3279-4cc2-42c4-81e8-d8fb121dce0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:32.352077 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b3279-4cc2-42c4-81e8-d8fb121dce0c None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:32.352373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b3279-4cc2-42c4-81e8-d8fb121dce0c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:32.352630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b3279-4cc2-42c4-81e8-d8fb121dce0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:32.359355 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b3279-4cc2-42c4-81e8-d8fb121dce0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:32.360856 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b3279-4cc2-42c4-81e8-d8fb121dce0c None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:32.372066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-594b3279-4cc2-42c4-81e8-d8fb121dce0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:53:32.372066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:32.372066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:32.372066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:32.372066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:32.372066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:32.372066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:32.372066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:32.372066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:32.372066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:32.372066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:32.372066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:32.372066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:53:32.372066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:53:32.372066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:32.373192 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:32.374465 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:53:32.374465 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:53:32.374465 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:53:32.374465 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:53:32.374465 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:53:32.374465 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:53:32.374465 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:53:32.374465 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:32.374465 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 437/879] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:53:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:32.379240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bd166-bdd4-44a3-88bc-e4ef34f028f7 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:32.483638 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bd166-bdd4-44a3-88bc-e4ef34f028f7 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:32.516692 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ec0c7-c4a0-4885-aeac-7c8d0acf96ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:32.517299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ec0c7-c4a0-4885-aeac-7c8d0acf96ec None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:32.518088 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ec0c7-c4a0-4885-aeac-7c8d0acf96ec None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:32.518364 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ec0c7-c4a0-4885-aeac-7c8d0acf96ec None admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:32.519085 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ec0c7-c4a0-4885-aeac-7c8d0acf96ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:32.519393 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ec0c7-c4a0-4885-aeac-7c8d0acf96ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:32.520906 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ec0c7-c4a0-4885-aeac-7c8d0acf96ec None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:32.534392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 443/880] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:53:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:32.541484 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b3279-4cc2-42c4-81e8-d8fb121dce0c None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:32.566345 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:32.644904 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b3279-4cc2-42c4-81e8-d8fb121dce0c None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:32.680177 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f6dad-4072-4192-abc8-9955604f4771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:32.680782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f6dad-4072-4192-abc8-9955604f4771 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:32.681060 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f6dad-4072-4192-abc8-9955604f4771 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:32.681330 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f6dad-4072-4192-abc8-9955604f4771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:32.682050 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f6dad-4072-4192-abc8-9955604f4771 None admin] RBAC: Adding query filter params (role.id=e73a8fc0684c4f6083a71ea9a85c7298, scope.project.id=c6af527bb8974bc6915553d99df0901e, user.id=49070d8a078644f4a9e17deab052ba41) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:32.682356 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f6dad-4072-4192-abc8-9955604f4771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:32.683839 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f6dad-4072-4192-abc8-9955604f4771 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:32.690586 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 438/881] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:53:32 2022] GET /identity/v3/role_assignments?user.id=49070d8a078644f4a9e17deab052ba41&scope.project.id=c6af527bb8974bc6915553d99df0901e&role.id=e73a8fc0684c4f6083a71ea9a85c7298 => generated 260 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:34.888367 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07796bca-bda5-4ec8-945a-a416e539c188 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:34.888918 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07796bca-bda5-4ec8-945a-a416e539c188 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:34.888918 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07796bca-bda5-4ec8-945a-a416e539c188 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:34.890215 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 444/882] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:53:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:53:34.896164 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2375c-4a9b-4575-8c01-fda3db6f066c None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:34.896651 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2375c-4a9b-4575-8c01-fda3db6f066c None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:34.896752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2375c-4a9b-4575-8c01-fda3db6f066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:34.914565 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-36a2375c-4a9b-4575-8c01-fda3db6f066c None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:34.915780 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-36a2375c-4a9b-4575-8c01-fda3db6f066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:34.983773 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 439/883] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:53:34 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:53:35.317210 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07796bca-bda5-4ec8-945a-a416e539c188 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:35.329084 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:35.424183 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07796bca-bda5-4ec8-945a-a416e539c188 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:35.467056 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affbc86-e17a-4c31-860e-639775e80dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:35.467693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affbc86-e17a-4c31-860e-639775e80dd6 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:35.467974 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affbc86-e17a-4c31-860e-639775e80dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:35.468244 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affbc86-e17a-4c31-860e-639775e80dd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:35.481106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affbc86-e17a-4c31-860e-639775e80dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-4affbc86-e17a-4c31-860e-639775e80dd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:53:35.485898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:35.488494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:35.490392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:35.490392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:35.490392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:35.490392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:35.490392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:53:35.490392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:53:35.490392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:53:35.490392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:53:35.490392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:53:35.490392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:53:35.490392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:53:35.490392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:35.490392 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 445/884] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:35.495770 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2375c-4a9b-4575-8c01-fda3db6f066c None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:35.511377 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:35.606489 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2375c-4a9b-4575-8c01-fda3db6f066c None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:35.645366 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2dc86-e190-4500-a630-42b2c676bb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:35.645975 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2dc86-e190-4500-a630-42b2c676bb27 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:35.646277 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2dc86-e190-4500-a630-42b2c676bb27 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:35.646546 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2dc86-e190-4500-a630-42b2c676bb27 None admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:35.647276 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2dc86-e190-4500-a630-42b2c676bb27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:35.647727 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2dc86-e190-4500-a630-42b2c676bb27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:35.649184 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2dc86-e190-4500-a630-42b2c676bb27 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:35.657938 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 440/885] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:53:35 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:35.664707 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affbc86-e17a-4c31-860e-639775e80dd6 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:35.739795 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:35.773182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affbc86-e17a-4c31-860e-639775e80dd6 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:35.815283 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f8589-608d-4a7d-9277-14e323c86ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:35.815995 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f8589-608d-4a7d-9277-14e323c86ec3 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:35.816260 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f8589-608d-4a7d-9277-14e323c86ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:35.816548 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f8589-608d-4a7d-9277-14e323c86ec3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:35.829655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f8589-608d-4a7d-9277-14e323c86ec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:35.832025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f8589-608d-4a7d-9277-14e323c86ec3 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-167f8589-608d-4a7d-9277-14e323c86ec3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:53:35.848785 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:35.850112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:53:35.851215 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:53:35.851215 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:35.851215 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:35.851215 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 446/886] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:35.856121 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2dc86-e190-4500-a630-42b2c676bb27 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:35.940755 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:35.964019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2dc86-e190-4500-a630-42b2c676bb27 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:35.999975 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6d8b5-a266-4cf6-819c-1769462581cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:36.000581 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6d8b5-a266-4cf6-819c-1769462581cb None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:36.000852 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6d8b5-a266-4cf6-819c-1769462581cb None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:36.001117 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6d8b5-a266-4cf6-819c-1769462581cb None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:36.001765 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6d8b5-a266-4cf6-819c-1769462581cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:36.002627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6d8b5-a266-4cf6-819c-1769462581cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:36.004527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6d8b5-a266-4cf6-819c-1769462581cb None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:36.016744 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 441/887] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:53:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:53:36.023903 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f8589-608d-4a7d-9277-14e323c86ec3 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:36.131824 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f8589-608d-4a7d-9277-14e323c86ec3 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:36.152506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:36.167878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfdb1f-854d-47aa-bad6-746b5ad6cc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:36.168506 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfdb1f-854d-47aa-bad6-746b5ad6cc55 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:36.168780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfdb1f-854d-47aa-bad6-746b5ad6cc55 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:36.169043 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfdb1f-854d-47aa-bad6-746b5ad6cc55 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:36.176989 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfdb1f-854d-47aa-bad6-746b5ad6cc55 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:36.178418 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfdb1f-854d-47aa-bad6-746b5ad6cc55 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-59dfdb1f-854d-47aa-bad6-746b5ad6cc55 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:53:36.191912 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:36.193611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:36.196113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:36.196113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:36.196113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:53:36.196113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:53:36.196113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:53:36.196113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:53:36.196113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:53:36.196113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:53:36.196113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:53:36.196113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:36.196113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 447/888] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:36.198567 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6d8b5-a266-4cf6-819c-1769462581cb None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:36.303341 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6d8b5-a266-4cf6-819c-1769462581cb None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:36.340705 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34da0a-b52a-4a6c-bfad-586ef2197c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:36.341323 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34da0a-b52a-4a6c-bfad-586ef2197c6f None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:36.341604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34da0a-b52a-4a6c-bfad-586ef2197c6f None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:36.341878 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34da0a-b52a-4a6c-bfad-586ef2197c6f None admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:36.342609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34da0a-b52a-4a6c-bfad-586ef2197c6f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:36.342951 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34da0a-b52a-4a6c-bfad-586ef2197c6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:36.345196 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34da0a-b52a-4a6c-bfad-586ef2197c6f None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:36.348802 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:36.365166 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 442/889] 10.222.0.121 () {56 vars in 1148 bytes} [Fri Aug 26 00:53:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:36.371296 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfdb1f-854d-47aa-bad6-746b5ad6cc55 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:36.480072 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfdb1f-854d-47aa-bad6-746b5ad6cc55 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:36.519897 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffc6fd-6e78-4344-842f-ad3d84cb972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:36.520543 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffc6fd-6e78-4344-842f-ad3d84cb972e None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:36.520854 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffc6fd-6e78-4344-842f-ad3d84cb972e None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:36.521094 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffc6fd-6e78-4344-842f-ad3d84cb972e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:36.534625 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffc6fd-6e78-4344-842f-ad3d84cb972e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:36.536128 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffc6fd-6e78-4344-842f-ad3d84cb972e None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-65ffc6fd-6e78-4344-842f-ad3d84cb972e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:53:36.551106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:36.552308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:53:36.553456 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:53:36.553456 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:36.553456 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:36.553456 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 448/890] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:36.558075 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34da0a-b52a-4a6c-bfad-586ef2197c6f None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:36.673298 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34da0a-b52a-4a6c-bfad-586ef2197c6f None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:36.713197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009b454-f12a-40d7-883e-f632ee10a30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:36.713823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009b454-f12a-40d7-883e-f632ee10a30e None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:36.714104 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009b454-f12a-40d7-883e-f632ee10a30e None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:36.714377 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009b454-f12a-40d7-883e-f632ee10a30e None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:36.715066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009b454-f12a-40d7-883e-f632ee10a30e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:36.715373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009b454-f12a-40d7-883e-f632ee10a30e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:36.716783 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009b454-f12a-40d7-883e-f632ee10a30e None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:36.729552 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 443/891] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:53:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:36.740149 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffc6fd-6e78-4344-842f-ad3d84cb972e None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:36.779110 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:36.854062 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffc6fd-6e78-4344-842f-ad3d84cb972e None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:36.895572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f51ea-694d-40fa-9937-62b764f5bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:36.896227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f51ea-694d-40fa-9937-62b764f5bbcf None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:36.896502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f51ea-694d-40fa-9937-62b764f5bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:36.896774 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f51ea-694d-40fa-9937-62b764f5bbcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:36.904458 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f51ea-694d-40fa-9937-62b764f5bbcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:36.905906 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f51ea-694d-40fa-9937-62b764f5bbcf None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:36.917726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-cb2f51ea-694d-40fa-9937-62b764f5bbcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:53:36.917726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:36.917726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:36.917726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:36.917726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:36.917726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:36.917726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:36.917726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:36.917726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:36.917726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:36.917726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:36.917726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:36.917726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:53:36.917726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:53:36.917726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:36.919202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:36.920291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:53:36.920291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:53:36.920291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:53:36.920291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:53:36.920291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:53:36.920291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:53:36.920291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:53:36.920291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:36.920291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 449/892] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:53:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:36.925818 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009b454-f12a-40d7-883e-f632ee10a30e None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:36.982653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:37.037202 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009b454-f12a-40d7-883e-f632ee10a30e None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:37.073480 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265e68a-fb0d-4370-85a8-e84d596efa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:37.074089 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265e68a-fb0d-4370-85a8-e84d596efa47 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:37.074398 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265e68a-fb0d-4370-85a8-e84d596efa47 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:37.074706 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265e68a-fb0d-4370-85a8-e84d596efa47 None admin] PATH_INFO: `/v3/projects` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:37.075465 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265e68a-fb0d-4370-85a8-e84d596efa47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:37.075777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265e68a-fb0d-4370-85a8-e84d596efa47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:37.077330 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265e68a-fb0d-4370-85a8-e84d596efa47 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:37.090934 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 444/893] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:53:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:37.097584 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f51ea-694d-40fa-9937-62b764f5bbcf None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:37.194981 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:37.203386 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f51ea-694d-40fa-9937-62b764f5bbcf None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:37.237608 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4876ae-45c9-436a-808e-ebb9d98dc7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:37.238267 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4876ae-45c9-436a-808e-ebb9d98dc7a8 None admin] REQUEST_METHOD: `PUT` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:37.238548 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4876ae-45c9-436a-808e-ebb9d98dc7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:37.238859 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4876ae-45c9-436a-808e-ebb9d98dc7a8 None admin] PATH_INFO: `/v3/projects/c6af527bb8974bc6915553d99df0901e/users/49070d8a078644f4a9e17deab052ba41/roles/e73a8fc0684c4f6083a71ea9a85c7298` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:37.240777 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4876ae-45c9-436a-808e-ebb9d98dc7a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6af527bb8974bc6915553d99df0901e, user_id=49070d8a078644f4a9e17deab052ba41, role_id=e73a8fc0684c4f6083a71ea9a85c7298)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:37.242238 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4876ae-45c9-436a-808e-ebb9d98dc7a8 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:37.623951 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 450/894] 10.222.0.121 () {58 vars in 1444 bytes} [Fri Aug 26 00:53:37 2022] PUT /identity/v3/projects/c6af527bb8974bc6915553d99df0901e/users/49070d8a078644f4a9e17deab052ba41/roles/e73a8fc0684c4f6083a71ea9a85c7298 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:53:39.930450 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc242b41-5c73-4877-bd17-42297956ca52 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:39.931324 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc242b41-5c73-4877-bd17-42297956ca52 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:39.931478 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc242b41-5c73-4877-bd17-42297956ca52 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:39.932922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 445/895] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:53:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:53:39.938127 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f3ae7-b00b-48e3-862f-dd04539f493a None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:39.938792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f3ae7-b00b-48e3-862f-dd04539f493a None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:39.938987 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f3ae7-b00b-48e3-862f-dd04539f493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:39.958427 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-7b6f3ae7-b00b-48e3-862f-dd04539f493a None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:39.959701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-7b6f3ae7-b00b-48e3-862f-dd04539f493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:40.030766 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 451/896] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:53:39 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:53:40.380626 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc242b41-5c73-4877-bd17-42297956ca52 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:40.495464 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc242b41-5c73-4877-bd17-42297956ca52 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:40.510434 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:40.530612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186147e-f474-4287-bbbf-43fb2e5c5615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:40.531273 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186147e-f474-4287-bbbf-43fb2e5c5615 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:40.531552 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186147e-f474-4287-bbbf-43fb2e5c5615 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:40.531821 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186147e-f474-4287-bbbf-43fb2e5c5615 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:40.542299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186147e-f474-4287-bbbf-43fb2e5c5615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-d186147e-f474-4287-bbbf-43fb2e5c5615 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:53:40.547061 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:40.548243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:40.550313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:40.550313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:40.550313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:40.550313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:40.550313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:53:40.550313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:53:40.550313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:53:40.550313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:53:40.550313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:53:40.550313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:53:40.550313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:53:40.550313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:40.550313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 446/897] 10.222.0.121 () {56 vars in 1101 bytes} [Fri Aug 26 00:53:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:40.557106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f3ae7-b00b-48e3-862f-dd04539f493a None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:40.645772 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:40.663988 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f3ae7-b00b-48e3-862f-dd04539f493a None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:40.699851 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b138c3-b6a0-4e76-9182-d00c52b948c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:40.700457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b138c3-b6a0-4e76-9182-d00c52b948c9 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:40.700726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b138c3-b6a0-4e76-9182-d00c52b948c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:40.700990 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b138c3-b6a0-4e76-9182-d00c52b948c9 None admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:40.701693 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b138c3-b6a0-4e76-9182-d00c52b948c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:40.701990 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b138c3-b6a0-4e76-9182-d00c52b948c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:40.703415 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b138c3-b6a0-4e76-9182-d00c52b948c9 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:40.711623 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 452/898] 10.222.0.121 () {56 vars in 1104 bytes} [Fri Aug 26 00:53:40 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:40.717763 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186147e-f474-4287-bbbf-43fb2e5c5615 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:40.831156 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186147e-f474-4287-bbbf-43fb2e5c5615 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:40.866894 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8c100-c964-482d-a76b-f2f9fb5b0886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:40.867546 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8c100-c964-482d-a76b-f2f9fb5b0886 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:40.867823 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8c100-c964-482d-a76b-f2f9fb5b0886 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:40.868094 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8c100-c964-482d-a76b-f2f9fb5b0886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:40.879351 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8c100-c964-482d-a76b-f2f9fb5b0886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:40.881080 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8c100-c964-482d-a76b-f2f9fb5b0886 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-56d8c100-c964-482d-a76b-f2f9fb5b0886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:53:40.894675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:40.895827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:53:40.896711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:53:40.896711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:40.896711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:40.896711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 447/899] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:40.901730 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b138c3-b6a0-4e76-9182-d00c52b948c9 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:41.005937 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b138c3-b6a0-4e76-9182-d00c52b948c9 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:41.043097 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880541f-8afd-4de3-854e-2c9e72d415c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:41.043701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880541f-8afd-4de3-854e-2c9e72d415c9 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:41.043977 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880541f-8afd-4de3-854e-2c9e72d415c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:41.044470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880541f-8afd-4de3-854e-2c9e72d415c9 None admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:41.044970 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880541f-8afd-4de3-854e-2c9e72d415c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:41.045268 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880541f-8afd-4de3-854e-2c9e72d415c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:41.046624 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880541f-8afd-4de3-854e-2c9e72d415c9 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:41.059945 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 453/900] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:53:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:41.066296 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8c100-c964-482d-a76b-f2f9fb5b0886 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:41.098092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:41.177022 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8c100-c964-482d-a76b-f2f9fb5b0886 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:41.211976 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebb303-d2a1-4cef-899a-def283300193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:41.212626 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb303-d2a1-4cef-899a-def283300193 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:41.212909 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb303-d2a1-4cef-899a-def283300193 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:41.213187 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb303-d2a1-4cef-899a-def283300193 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:41.222491 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebb303-d2a1-4cef-899a-def283300193 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:41.224016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebb303-d2a1-4cef-899a-def283300193 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-c7ebb303-d2a1-4cef-899a-def283300193 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:53:41.236782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:41.237946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:41.239339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:41.239339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:41.239339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:53:41.239339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:53:41.239339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:53:41.239339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:53:41.239339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:53:41.239339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:53:41.239339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:53:41.239339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:41.239339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 448/901] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:41.243885 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880541f-8afd-4de3-854e-2c9e72d415c9 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:41.247761 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:41.349961 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880541f-8afd-4de3-854e-2c9e72d415c9 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:41.385855 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431e9a8-140c-46a3-adfd-38bee301b313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:41.386467 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431e9a8-140c-46a3-adfd-38bee301b313 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:41.386750 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431e9a8-140c-46a3-adfd-38bee301b313 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:41.387204 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431e9a8-140c-46a3-adfd-38bee301b313 None admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:41.387980 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431e9a8-140c-46a3-adfd-38bee301b313 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:41.388289 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431e9a8-140c-46a3-adfd-38bee301b313 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:41.389745 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431e9a8-140c-46a3-adfd-38bee301b313 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:41.410456 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 454/902] 10.222.0.121 () {56 vars in 1148 bytes} [Fri Aug 26 00:53:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:41.417092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebb303-d2a1-4cef-899a-def283300193 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:41.514445 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:41.530946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebb303-d2a1-4cef-899a-def283300193 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:41.570253 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b368dd5-6bc5-48af-9db0-29ab096abc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:41.570903 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b368dd5-6bc5-48af-9db0-29ab096abc7d None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:41.571184 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b368dd5-6bc5-48af-9db0-29ab096abc7d None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:41.571452 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b368dd5-6bc5-48af-9db0-29ab096abc7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:41.651854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b368dd5-6bc5-48af-9db0-29ab096abc7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:41.653399 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b368dd5-6bc5-48af-9db0-29ab096abc7d None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:41.786975 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:41.803639 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 449/903] 10.222.0.121 () {58 vars in 1287 bytes} [Fri Aug 26 00:53:41 2022] GET /identity/v3/auth/tokens => generated 1873 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:53:41.809585 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431e9a8-140c-46a3-adfd-38bee301b313 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:41.887533 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:41.927554 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431e9a8-140c-46a3-adfd-38bee301b313 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:41.964421 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feb81d-72b2-44f7-83a9-dc93c5732bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:41.965249 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feb81d-72b2-44f7-83a9-dc93c5732bd0 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:41.965491 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feb81d-72b2-44f7-83a9-dc93c5732bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:41.965764 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feb81d-72b2-44f7-83a9-dc93c5732bd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:41.976650 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feb81d-72b2-44f7-83a9-dc93c5732bd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:41.978105 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feb81d-72b2-44f7-83a9-dc93c5732bd0 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-66feb81d-72b2-44f7-83a9-dc93c5732bd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:53:41.994150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:41.996309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:53:41.997416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:53:41.997416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:53:41.997416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:41.997416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 455/904] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 00:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:42.001592 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b368dd5-6bc5-48af-9db0-29ab096abc7d None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:42.107532 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b368dd5-6bc5-48af-9db0-29ab096abc7d None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:42.143854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc401d-6891-44ef-8352-36aa60b5f61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:42.144556 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc401d-6891-44ef-8352-36aa60b5f61c None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:42.144829 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc401d-6891-44ef-8352-36aa60b5f61c None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:42.145094 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc401d-6891-44ef-8352-36aa60b5f61c None admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:42.145736 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc401d-6891-44ef-8352-36aa60b5f61c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:42.146033 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc401d-6891-44ef-8352-36aa60b5f61c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:42.147953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc401d-6891-44ef-8352-36aa60b5f61c None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:42.161385 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 450/905] 10.222.0.121 () {56 vars in 1114 bytes} [Fri Aug 26 00:53:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:42.167649 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feb81d-72b2-44f7-83a9-dc93c5732bd0 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:42.278057 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feb81d-72b2-44f7-83a9-dc93c5732bd0 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:42.292573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:42.313920 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc80d43-8eff-4c0c-a29e-1a059863fec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:42.315147 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc80d43-8eff-4c0c-a29e-1a059863fec1 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:42.315425 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc80d43-8eff-4c0c-a29e-1a059863fec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:42.315692 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc80d43-8eff-4c0c-a29e-1a059863fec1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:42.324068 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc80d43-8eff-4c0c-a29e-1a059863fec1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:42.325524 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc80d43-8eff-4c0c-a29e-1a059863fec1 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:42.338841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application [None req-2dc80d43-8eff-4c0c-a29e-1a059863fec1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:53:42.338841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:42.338841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:42.338841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:42.338841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:42.338841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:42.338841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:42.338841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:42.338841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:42.338841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:42.338841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:42.338841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:42.338841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:53:42.338841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:53:42.338841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:42.339839 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:42.340806 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:53:42.340806 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:53:42.340806 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:53:42.340806 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:53:42.340806 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:53:42.340806 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:53:42.340806 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:53:42.340806 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: ERROR keystone.server.flask.application Aug 26 00:53:42.340806 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 456/906] 10.222.0.121 () {56 vars in 1116 bytes} [Fri Aug 26 00:53:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:42.346648 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc401d-6891-44ef-8352-36aa60b5f61c None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:42.395082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:42.452209 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc401d-6891-44ef-8352-36aa60b5f61c None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:42.490889 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfb364-40bf-4a35-89a9-f40f51424c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:42.491957 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfb364-40bf-4a35-89a9-f40f51424c26 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:42.492298 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfb364-40bf-4a35-89a9-f40f51424c26 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:42.492566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfb364-40bf-4a35-89a9-f40f51424c26 None admin] PATH_INFO: `/v3/projects` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:42.493305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfb364-40bf-4a35-89a9-f40f51424c26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:42.493607 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfb364-40bf-4a35-89a9-f40f51424c26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:42.495130 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfb364-40bf-4a35-89a9-f40f51424c26 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:42.508305 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 451/907] 10.222.0.121 () {56 vars in 1153 bytes} [Fri Aug 26 00:53:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:42.514776 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc80d43-8eff-4c0c-a29e-1a059863fec1 None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:42.629740 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc80d43-8eff-4c0c-a29e-1a059863fec1 None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:42.677333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273fd53-3731-4811-bcc3-7f26763a5cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:42.677922 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273fd53-3731-4811-bcc3-7f26763a5cc9 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:42.678194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273fd53-3731-4811-bcc3-7f26763a5cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:42.678466 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273fd53-3731-4811-bcc3-7f26763a5cc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:42.679207 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273fd53-3731-4811-bcc3-7f26763a5cc9 None admin] RBAC: Adding query filter params (role.id=e73a8fc0684c4f6083a71ea9a85c7298, scope.project.id=c6af527bb8974bc6915553d99df0901e, user.id=49070d8a078644f4a9e17deab052ba41) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:42.679511 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273fd53-3731-4811-bcc3-7f26763a5cc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:42.680938 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273fd53-3731-4811-bcc3-7f26763a5cc9 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:42.690809 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 457/908] 10.222.0.121 () {56 vars in 1379 bytes} [Fri Aug 26 00:53:42 2022] GET /identity/v3/role_assignments?user.id=49070d8a078644f4a9e17deab052ba41&scope.project.id=c6af527bb8974bc6915553d99df0901e&role.id=e73a8fc0684c4f6083a71ea9a85c7298 => generated 610 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:44.997466 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846d50d-efe4-45b4-9985-263b8666e1ba None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:44.998048 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846d50d-efe4-45b4-9985-263b8666e1ba None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:44.998048 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846d50d-efe4-45b4-9985-263b8666e1ba None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:44.999438 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 452/909] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:53:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:53:45.005640 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799aaa1-891b-4c9d-98b5-c7d5a6163a52 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:45.006191 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799aaa1-891b-4c9d-98b5-c7d5a6163a52 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:45.006191 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799aaa1-891b-4c9d-98b5-c7d5a6163a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:45.024743 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-7799aaa1-891b-4c9d-98b5-c7d5a6163a52 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:45.025979 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-7799aaa1-891b-4c9d-98b5-c7d5a6163a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:45.056080 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:45.096103 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 458/910] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:53:45 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:53:45.434242 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846d50d-efe4-45b4-9985-263b8666e1ba None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:45.542430 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846d50d-efe4-45b4-9985-263b8666e1ba None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:45.550473 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:45.579047 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a4473-893f-4d36-b59c-cbccf7ad78c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:45.579710 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4473-893f-4d36-b59c-cbccf7ad78c9 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:45.580521 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4473-893f-4d36-b59c-cbccf7ad78c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:45.580793 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4473-893f-4d36-b59c-cbccf7ad78c9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:45.581372 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a4473-893f-4d36-b59c-cbccf7ad78c9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:45.582754 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a4473-893f-4d36-b59c-cbccf7ad78c9 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-697a4473-893f-4d36-b59c-cbccf7ad78c9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:45.591347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:45.592996 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:45.594235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:45.594235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:45.594235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:45.594235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:45.594235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:45.594235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:45.594235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:45.594235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:45.594235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:45.594235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:45.594235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:53:45.594235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:53:45.594235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:53:45.594235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:45.594235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 453/911] 10.222.0.121 () {56 vars in 1122 bytes} [Fri Aug 26 00:53:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:45.599404 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799aaa1-891b-4c9d-98b5-c7d5a6163a52 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:45.710626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799aaa1-891b-4c9d-98b5-c7d5a6163a52 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:45.748643 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959eefd-520e-47d1-a57a-fb461f4f6e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:45.749250 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959eefd-520e-47d1-a57a-fb461f4f6e7d None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:45.749528 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959eefd-520e-47d1-a57a-fb461f4f6e7d None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:45.749798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959eefd-520e-47d1-a57a-fb461f4f6e7d None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:45.750429 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959eefd-520e-47d1-a57a-fb461f4f6e7d None admin] RBAC: Adding query filter params (name=placement) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:45.750730 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959eefd-520e-47d1-a57a-fb461f4f6e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:45.752879 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959eefd-520e-47d1-a57a-fb461f4f6e7d None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:45.758224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 459/912] 10.222.0.121 () {56 vars in 1121 bytes} [Fri Aug 26 00:53:45 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:45.771254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a4473-893f-4d36-b59c-cbccf7ad78c9 None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:45.868190 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a4473-893f-4d36-b59c-cbccf7ad78c9 None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:45.902187 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62866e1d-53b4-410d-9179-e5489731095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:45.902788 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62866e1d-53b4-410d-9179-e5489731095e None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:45.903099 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62866e1d-53b4-410d-9179-e5489731095e None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:45.903373 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62866e1d-53b4-410d-9179-e5489731095e None admin] PATH_INFO: `/v3/services` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:45.904004 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62866e1d-53b4-410d-9179-e5489731095e None admin] RBAC: Adding query filter params (type=placement) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:45.904306 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62866e1d-53b4-410d-9179-e5489731095e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:45.905680 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62866e1d-53b4-410d-9179-e5489731095e None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:45.910268 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 454/913] 10.222.0.121 () {56 vars in 1121 bytes} [Fri Aug 26 00:53:45 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:48.101148 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb182c-db18-45a4-9979-e744fd6b6965 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:48.101759 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb182c-db18-45a4-9979-e744fd6b6965 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:48.101759 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb182c-db18-45a4-9979-e744fd6b6965 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:48.103157 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 460/914] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:53:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:53:48.108460 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328d6b1-39cd-455c-a79d-9eb0421fa987 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:48.108903 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328d6b1-39cd-455c-a79d-9eb0421fa987 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:48.109009 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328d6b1-39cd-455c-a79d-9eb0421fa987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:48.128361 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-0328d6b1-39cd-455c-a79d-9eb0421fa987 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:48.129556 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-0328d6b1-39cd-455c-a79d-9eb0421fa987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:48.156948 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:48.197989 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 455/915] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:53:48 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:53:48.528299 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb182c-db18-45a4-9979-e744fd6b6965 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:48.561911 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:48.634427 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb182c-db18-45a4-9979-e744fd6b6965 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:48.668218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219145b9-649f-4ca3-81a3-e7032e87ecdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:48.668813 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219145b9-649f-4ca3-81a3-e7032e87ecdb None admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:48.669087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219145b9-649f-4ca3-81a3-e7032e87ecdb None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:48.669358 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219145b9-649f-4ca3-81a3-e7032e87ecdb None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:48.669999 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219145b9-649f-4ca3-81a3-e7032e87ecdb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:48.671383 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219145b9-649f-4ca3-81a3-e7032e87ecdb None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:48.848202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 461/916] 10.222.0.121 () {60 vars in 1146 bytes} [Fri Aug 26 00:53:48 2022] POST /identity/v3/services => generated 247 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:53:51.112991 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e069e42-1e89-4602-818a-7a2932173151 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:51.113545 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e069e42-1e89-4602-818a-7a2932173151 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:51.113545 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e069e42-1e89-4602-818a-7a2932173151 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:51.114916 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 456/917] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:53:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 00:53:51.120150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd558cf0-4889-40a8-9982-b2432ab2c4f1 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:51.120588 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd558cf0-4889-40a8-9982-b2432ab2c4f1 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:51.120712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd558cf0-4889-40a8-9982-b2432ab2c4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:51.138773 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-cd558cf0-4889-40a8-9982-b2432ab2c4f1 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:51.140019 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-cd558cf0-4889-40a8-9982-b2432ab2c4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:51.231725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 462/918] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:53:51 2022] POST /identity/v3/auth/tokens => generated 1976 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:53:51.556528 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e069e42-1e89-4602-818a-7a2932173151 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:51.661558 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e069e42-1e89-4602-818a-7a2932173151 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:51.699674 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f3b98-fdbc-48ba-ada8-0457a0eb975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:51.700301 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f3b98-fdbc-48ba-ada8-0457a0eb975a None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:51.700577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f3b98-fdbc-48ba-ada8-0457a0eb975a None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:51.700846 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f3b98-fdbc-48ba-ada8-0457a0eb975a None admin] PATH_INFO: `/v3/services/placement` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:51.701425 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f3b98-fdbc-48ba-ada8-0457a0eb975a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:51.702803 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f3b98-fdbc-48ba-ada8-0457a0eb975a None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-b85f3b98-fdbc-48ba-ada8-0457a0eb975a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:51.711784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:51.715079 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:51.716223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:51.716223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:51.716223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:51.716223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:51.716223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:51.716223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:51.716223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:51.716223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:51.716223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:51.716223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:51.716223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:53:51.716223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:53:51.716223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:53:51.716223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:51.716223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 457/919] 10.222.0.121 () {56 vars in 1122 bytes} [Fri Aug 26 00:53:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:51.718937 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd558cf0-4889-40a8-9982-b2432ab2c4f1 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:51.737699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:51.818691 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd558cf0-4889-40a8-9982-b2432ab2c4f1 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:51.853425 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375707f-b051-498d-a262-510fa4d8729d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:51.854031 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375707f-b051-498d-a262-510fa4d8729d None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:51.854309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375707f-b051-498d-a262-510fa4d8729d None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:51.854577 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375707f-b051-498d-a262-510fa4d8729d None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:51.855231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375707f-b051-498d-a262-510fa4d8729d None admin] RBAC: Adding query filter params (name=placement) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:51.855533 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375707f-b051-498d-a262-510fa4d8729d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:51.856904 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375707f-b051-498d-a262-510fa4d8729d None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:51.863264 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 463/920] 10.222.0.121 () {56 vars in 1121 bytes} [Fri Aug 26 00:53:51 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:51.871548 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f3b98-fdbc-48ba-ada8-0457a0eb975a None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:51.906945 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:51.990614 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f3b98-fdbc-48ba-ada8-0457a0eb975a None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:52.029954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf9ff5-9a45-451b-b70b-e79c0b1e5d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:52.030560 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf9ff5-9a45-451b-b70b-e79c0b1e5d15 None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:52.030856 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf9ff5-9a45-451b-b70b-e79c0b1e5d15 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:52.031142 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf9ff5-9a45-451b-b70b-e79c0b1e5d15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:52.031887 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf9ff5-9a45-451b-b70b-e79c0b1e5d15 None admin] RBAC: Adding query filter params (interface=public, service_id=2534fc715d0b4d858adb031ec31e4bc1, region_id=RegionOne) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:52.032145 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf9ff5-9a45-451b-b70b-e79c0b1e5d15 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:52.033571 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf9ff5-9a45-451b-b70b-e79c0b1e5d15 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:52.041692 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 458/921] 10.222.0.121 () {56 vars in 1256 bytes} [Fri Aug 26 00:53:51 2022] GET /identity/v3/endpoints?service_id=2534fc715d0b4d858adb031ec31e4bc1&interface=public®ion_id=RegionOne => generated 195 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:53:52.047999 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375707f-b051-498d-a262-510fa4d8729d None admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:52.135618 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:52.154963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375707f-b051-498d-a262-510fa4d8729d None admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:52.190637 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd280f8b-7e20-4e60-9af7-53a6aa56d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:52.191284 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd280f8b-7e20-4e60-9af7-53a6aa56d54f None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:52.191558 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd280f8b-7e20-4e60-9af7-53a6aa56d54f None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:52.191825 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd280f8b-7e20-4e60-9af7-53a6aa56d54f None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:52.192419 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd280f8b-7e20-4e60-9af7-53a6aa56d54f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:52.193822 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd280f8b-7e20-4e60-9af7-53a6aa56d54f None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:52.200312 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 464/922] 10.222.0.121 () {56 vars in 1092 bytes} [Fri Aug 26 00:53:52 2022] GET /identity/v3/services => generated 1971 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:53:54.439517 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfc559-a8a5-4d66-af58-5076d7a31315 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:54.440085 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfc559-a8a5-4d66-af58-5076d7a31315 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:54.440085 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfc559-a8a5-4d66-af58-5076d7a31315 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:54.441402 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 459/923] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 00:53:54 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 00:53:54.447502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdf0c1-b0cf-49c6-ba44-8cdb2096c06d None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:54.448030 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdf0c1-b0cf-49c6-ba44-8cdb2096c06d None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:54.448125 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdf0c1-b0cf-49c6-ba44-8cdb2096c06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:54.467649 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-46cdf0c1-b0cf-49c6-ba44-8cdb2096c06d None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:53:54.469001 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-46cdf0c1-b0cf-49c6-ba44-8cdb2096c06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:53:54.541675 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 465/924] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 00:53:54 2022] POST /identity/v3/auth/tokens => generated 1976 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:53:54.873106 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfc559-a8a5-4d66-af58-5076d7a31315 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:54.977597 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:54.991846 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfc559-a8a5-4d66-af58-5076d7a31315 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:55.029089 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa886a4-9238-4218-88c7-e44501896aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:55.034083 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa886a4-9238-4218-88c7-e44501896aed None admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:55.034083 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa886a4-9238-4218-88c7-e44501896aed None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:55.034083 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa886a4-9238-4218-88c7-e44501896aed None admin] PATH_INFO: `/v3/services/placement` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:55.034083 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa886a4-9238-4218-88c7-e44501896aed None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:55.034083 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa886a4-9238-4218-88c7-e44501896aed None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application [None req-dfa886a4-9238-4218-88c7-e44501896aed None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:53:55.041404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:53:55.042806 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:53:55.044019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:53:55.044019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application with Lock( Aug 26 00:53:55.044019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:53:55.044019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:53:55.044019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:53:55.044019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:53:55.044019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:53:55.044019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:53:55.044019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:53:55.044019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:53:55.044019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:53:55.044019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:53:55.044019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:53:55.044019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: ERROR keystone.server.flask.application Aug 26 00:53:55.044019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 460/925] 10.222.0.121 () {56 vars in 1122 bytes} [Fri Aug 26 00:53:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:53:55.049798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdf0c1-b0cf-49c6-ba44-8cdb2096c06d None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:55.133689 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:53:55.156701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdf0c1-b0cf-49c6-ba44-8cdb2096c06d None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:55.193590 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ce312-d9df-4681-bc78-825f89245421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:55.194193 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ce312-d9df-4681-bc78-825f89245421 None admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:55.194473 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ce312-d9df-4681-bc78-825f89245421 None admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:55.194736 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ce312-d9df-4681-bc78-825f89245421 None admin] PATH_INFO: `/v3/services` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:55.200330 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ce312-d9df-4681-bc78-825f89245421 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:53:55.200330 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ce312-d9df-4681-bc78-825f89245421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:55.200330 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ce312-d9df-4681-bc78-825f89245421 None admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:55.202017 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 466/926] 10.222.0.121 () {56 vars in 1121 bytes} [Fri Aug 26 00:53:55 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:53:55.207866 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa886a4-9238-4218-88c7-e44501896aed None admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:53:55.339590 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa886a4-9238-4218-88c7-e44501896aed None admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:53:55.377954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff5cf9-5b54-45d9-b5d8-2dcc59fba6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:53:55.378571 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff5cf9-5b54-45d9-b5d8-2dcc59fba6d9 None admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:53:55.378878 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff5cf9-5b54-45d9-b5d8-2dcc59fba6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:53:55.379157 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff5cf9-5b54-45d9-b5d8-2dcc59fba6d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:53:55.379834 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff5cf9-5b54-45d9-b5d8-2dcc59fba6d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:53:55.381224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff5cf9-5b54-45d9-b5d8-2dcc59fba6d9 None admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:53:55.549850 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 461/927] 10.222.0.121 () {60 vars in 1149 bytes} [Fri Aug 26 00:53:55 2022] POST /identity/v3/endpoints => generated 333 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:54:05.272015 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=30 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:54:05.544937 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:21.986746 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b40ac-9345-4397-9877-d6b9bef1cafb None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:21.987304 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b40ac-9345-4397-9877-d6b9bef1cafb None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:21.987304 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b40ac-9345-4397-9877-d6b9bef1cafb None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:21.994144 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48422b97-a784-4aab-b4ed-602599453b79 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:21.994630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48422b97-a784-4aab-b4ed-602599453b79 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:21.994709 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48422b97-a784-4aab-b4ed-602599453b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:21.997375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 467/928] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:02:21 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:02:22.085704 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-48422b97-a784-4aab-b4ed-602599453b79 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:22.086975 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-48422b97-a784-4aab-b4ed-602599453b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:22.218682 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 462/929] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:02:21 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:02:22.584668 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c13f7b-3635-40d1-bda0-28d1bb452d36 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:22.584950 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c13f7b-3635-40d1-bda0-28d1bb452d36 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:22.585221 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c13f7b-3635-40d1-bda0-28d1bb452d36 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:22.586725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 468/930] 10.222.0.121 () {54 vars in 970 bytes} [Fri Aug 26 01:02:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:02:22.593705 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581b944-2e62-45ee-b9b0-a4631a256cbd None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:22.593991 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581b944-2e62-45ee-b9b0-a4631a256cbd None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:22.594314 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581b944-2e62-45ee-b9b0-a4631a256cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:22.664089 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-5581b944-2e62-45ee-b9b0-a4631a256cbd None None] MFA Rules not processed for user `8b2d08cc51074be0801fd5df03e3e7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:22.665403 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-5581b944-2e62-45ee-b9b0-a4631a256cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:22.697782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:22.744535 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 463/931] 10.222.0.121 () {58 vars in 1067 bytes} [Fri Aug 26 01:02:22 2022] POST /identity/v3/auth/tokens => generated 2689 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:02:22.754996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c13f7b-3635-40d1-bda0-28d1bb452d36 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:02:22.764566 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c13f7b-3635-40d1-bda0-28d1bb452d36 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:02:22.768240 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00a923-204a-4312-bea2-3e83c6b4cf55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:02:22.768841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00a923-204a-4312-bea2-3e83c6b4cf55 service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:22.769114 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00a923-204a-4312-bea2-3e83c6b4cf55 service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:22.769382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00a923-204a-4312-bea2-3e83c6b4cf55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:22.778707 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00a923-204a-4312-bea2-3e83c6b4cf55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:02:22.780695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00a923-204a-4312-bea2-3e83c6b4cf55 service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:02:22.796976 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 469/932] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:02:22 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:02:25.300934 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ccde8-1321-4a3c-bd99-406d12f3f975 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:25.302044 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ccde8-1321-4a3c-bd99-406d12f3f975 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:25.302634 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ccde8-1321-4a3c-bd99-406d12f3f975 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:25.305290 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 464/933] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:02:25 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:02:25.310845 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5e0c1-6796-4988-aa84-2a9a9c76ca8d None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:25.311293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5e0c1-6796-4988-aa84-2a9a9c76ca8d None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:25.311519 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5e0c1-6796-4988-aa84-2a9a9c76ca8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:25.332013 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-02d5e0c1-6796-4988-aa84-2a9a9c76ca8d None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:25.333237 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-02d5e0c1-6796-4988-aa84-2a9a9c76ca8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:25.350072 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 470/934] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:02:25 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:02:25.683802 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ccde8-1321-4a3c-bd99-406d12f3f975 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:02:25.696144 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ccde8-1321-4a3c-bd99-406d12f3f975 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:02:25.699609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd341d23-266a-4674-83e8-217dfcf0860b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:02:25.700203 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd341d23-266a-4674-83e8-217dfcf0860b service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:25.700483 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd341d23-266a-4674-83e8-217dfcf0860b service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:25.700756 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd341d23-266a-4674-83e8-217dfcf0860b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:25.711309 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd341d23-266a-4674-83e8-217dfcf0860b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:02:25.712765 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd341d23-266a-4674-83e8-217dfcf0860b service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:02:25.722783 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 465/935] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:02:25 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:02:28.641291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a4919-b28d-4c31-9391-b8ae7f88b972 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:28.641857 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a4919-b28d-4c31-9391-b8ae7f88b972 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:28.641857 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a4919-b28d-4c31-9391-b8ae7f88b972 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:28.643210 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 471/936] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:02:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:02:28.648494 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48115be-7b37-4187-92a7-79f2e9da1c9a None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:28.648978 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48115be-7b37-4187-92a7-79f2e9da1c9a None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:28.649094 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48115be-7b37-4187-92a7-79f2e9da1c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:28.709573 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-c48115be-7b37-4187-92a7-79f2e9da1c9a None None] MFA Rules not processed for user `ee496f6834d34c428eca652ff60963ba`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:28.710847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-c48115be-7b37-4187-92a7-79f2e9da1c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:28.794992 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 466/937] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:02:28 2022] POST /identity/v3/auth/tokens => generated 2811 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:02:29.181280 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf1f0-c026-40fd-87f0-dbc059ba1057 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:29.181593 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf1f0-c026-40fd-87f0-dbc059ba1057 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:29.181878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf1f0-c026-40fd-87f0-dbc059ba1057 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:29.183374 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 472/938] 10.222.0.121 () {54 vars in 970 bytes} [Fri Aug 26 01:02:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:02:29.190937 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b85820-8953-4cfd-a94b-b934e4446839 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:29.191233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b85820-8953-4cfd-a94b-b934e4446839 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:29.191512 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b85820-8953-4cfd-a94b-b934e4446839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:29.220864 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-47b85820-8953-4cfd-a94b-b934e4446839 None None] MFA Rules not processed for user `8b2d08cc51074be0801fd5df03e3e7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:29.222170 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-47b85820-8953-4cfd-a94b-b934e4446839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:29.228952 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 467/939] 10.222.0.121 () {58 vars in 1067 bytes} [Fri Aug 26 01:02:29 2022] POST /identity/v3/auth/tokens => generated 2689 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:02:29.240038 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edf1f0-c026-40fd-87f0-dbc059ba1057 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:02:29.253189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edf1f0-c026-40fd-87f0-dbc059ba1057 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:02:29.258686 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4bb80-16f1-499f-b01e-ee8ca47b4092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:02:29.259792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4bb80-16f1-499f-b01e-ee8ca47b4092 service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:29.260258 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4bb80-16f1-499f-b01e-ee8ca47b4092 service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:29.260734 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4bb80-16f1-499f-b01e-ee8ca47b4092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:29.272939 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4bb80-16f1-499f-b01e-ee8ca47b4092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:02:29.274440 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4bb80-16f1-499f-b01e-ee8ca47b4092 service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:02:29.286043 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 473/940] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:02:29 2022] GET /identity/v3/auth/tokens => generated 2811 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:02:32.699366 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310481f-ebed-4384-ab58-821b7ddc4d24 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:32.699920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310481f-ebed-4384-ab58-821b7ddc4d24 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:32.699920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310481f-ebed-4384-ab58-821b7ddc4d24 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:32.701261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 468/941] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:02:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:02:32.707232 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162b1b0-627e-4206-b0a7-ecc499396917 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:32.707665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162b1b0-627e-4206-b0a7-ecc499396917 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:32.707801 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162b1b0-627e-4206-b0a7-ecc499396917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:32.727052 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-a162b1b0-627e-4206-b0a7-ecc499396917 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:32.728256 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-a162b1b0-627e-4206-b0a7-ecc499396917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:32.800747 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 474/942] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:02:32 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:02:33.148644 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310481f-ebed-4384-ab58-821b7ddc4d24 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:02:33.159522 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310481f-ebed-4384-ab58-821b7ddc4d24 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:02:33.163398 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b46f8a-b191-41d1-b0df-dff21fb3def1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:02:33.163990 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b46f8a-b191-41d1-b0df-dff21fb3def1 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:33.164267 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b46f8a-b191-41d1-b0df-dff21fb3def1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:33.164537 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b46f8a-b191-41d1-b0df-dff21fb3def1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:33.175977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b46f8a-b191-41d1-b0df-dff21fb3def1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:02:33.177484 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b46f8a-b191-41d1-b0df-dff21fb3def1 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:02:33.187963 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 469/943] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:02:33 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:02:36.599834 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23945936-f17c-44a0-a3a6-a980308cfc3d None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:36.600368 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23945936-f17c-44a0-a3a6-a980308cfc3d None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:36.600368 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23945936-f17c-44a0-a3a6-a980308cfc3d None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:36.601763 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 475/944] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:02:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:02:36.608188 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c242384-993f-4928-9c5e-992221f2c716 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:36.609208 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c242384-993f-4928-9c5e-992221f2c716 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:36.609285 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c242384-993f-4928-9c5e-992221f2c716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:36.631172 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-7c242384-993f-4928-9c5e-992221f2c716 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:36.632399 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-7c242384-993f-4928-9c5e-992221f2c716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:36.641199 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 470/945] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:02:36 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:02:37.011137 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23945936-f17c-44a0-a3a6-a980308cfc3d None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:02:37.021965 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23945936-f17c-44a0-a3a6-a980308cfc3d None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:02:37.025684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e41d7-00ee-4651-989f-aff8d739b808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:02:37.026289 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e41d7-00ee-4651-989f-aff8d739b808 service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:37.026569 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e41d7-00ee-4651-989f-aff8d739b808 service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:37.026873 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e41d7-00ee-4651-989f-aff8d739b808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:37.037293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e41d7-00ee-4651-989f-aff8d739b808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:02:37.038733 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e41d7-00ee-4651-989f-aff8d739b808 service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:02:37.049158 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 476/946] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:02:37 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:02:39.338627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1b7e8-4af6-4ee4-b3e2-0ae32c6a4609 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:39.339222 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1b7e8-4af6-4ee4-b3e2-0ae32c6a4609 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:39.339600 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1b7e8-4af6-4ee4-b3e2-0ae32c6a4609 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:39.341324 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 471/947] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:02:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:02:39.346775 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa933-bba9-4abd-9733-2c639240d50a None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:39.347196 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa933-bba9-4abd-9733-2c639240d50a None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:39.347383 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa933-bba9-4abd-9733-2c639240d50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:39.367607 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-c3afa933-bba9-4abd-9733-2c639240d50a None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:39.368859 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-c3afa933-bba9-4abd-9733-2c639240d50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:39.378013 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 477/948] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:02:39 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:02:39.735042 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1b7e8-4af6-4ee4-b3e2-0ae32c6a4609 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:02:39.748527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1b7e8-4af6-4ee4-b3e2-0ae32c6a4609 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:02:39.752999 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eccca1-2440-48db-9114-524b5b703895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:02:39.753615 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eccca1-2440-48db-9114-524b5b703895 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:39.754527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eccca1-2440-48db-9114-524b5b703895 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:39.754527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eccca1-2440-48db-9114-524b5b703895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:39.764424 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eccca1-2440-48db-9114-524b5b703895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:02:39.766402 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eccca1-2440-48db-9114-524b5b703895 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:02:39.776319 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 472/949] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:02:39 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:02:42.061242 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40bf42-2b5a-4e2b-97e9-05488da21cb5 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:42.062377 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40bf42-2b5a-4e2b-97e9-05488da21cb5 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:42.062377 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40bf42-2b5a-4e2b-97e9-05488da21cb5 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:42.063800 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 478/950] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:02:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:02:42.069415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1949c85-f956-48dc-89d0-48d0d9c7f03a None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:42.069905 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1949c85-f956-48dc-89d0-48d0d9c7f03a None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:42.070020 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1949c85-f956-48dc-89d0-48d0d9c7f03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:42.090183 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-a1949c85-f956-48dc-89d0-48d0d9c7f03a None None] MFA Rules not processed for user `ee496f6834d34c428eca652ff60963ba`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:42.091425 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-a1949c85-f956-48dc-89d0-48d0d9c7f03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:42.099829 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 473/951] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:02:42 2022] POST /identity/v3/auth/tokens => generated 2811 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:02:42.442420 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40bf42-2b5a-4e2b-97e9-05488da21cb5 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:02:42.453659 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40bf42-2b5a-4e2b-97e9-05488da21cb5 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:02:42.457087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47d3ab-d6f5-4edb-ab11-61c31657b1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:02:42.457729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47d3ab-d6f5-4edb-ab11-61c31657b1aa service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:42.458001 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47d3ab-d6f5-4edb-ab11-61c31657b1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:42.458286 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47d3ab-d6f5-4edb-ab11-61c31657b1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:42.466743 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47d3ab-d6f5-4edb-ab11-61c31657b1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:02:42.468807 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47d3ab-d6f5-4edb-ab11-61c31657b1aa service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:02:42.478024 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 479/952] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:02:42 2022] GET /identity/v3/auth/tokens => generated 2811 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:02:45.272936 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73bf7f-20ee-4f9e-bf1d-362218a0347d None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:45.273531 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73bf7f-20ee-4f9e-bf1d-362218a0347d None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:45.273531 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73bf7f-20ee-4f9e-bf1d-362218a0347d None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:45.274920 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 474/953] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:02:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:02:45.280953 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b0d12-eb5a-4d35-bd41-7d55832fa56b None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:45.281418 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b0d12-eb5a-4d35-bd41-7d55832fa56b None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:45.281520 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b0d12-eb5a-4d35-bd41-7d55832fa56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:45.301470 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-983b0d12-eb5a-4d35-bd41-7d55832fa56b None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:45.302689 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-983b0d12-eb5a-4d35-bd41-7d55832fa56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:45.311433 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 480/954] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:02:45 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:02:45.655083 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73bf7f-20ee-4f9e-bf1d-362218a0347d None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:02:45.662427 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:45.667277 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73bf7f-20ee-4f9e-bf1d-362218a0347d None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:02:45.670887 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1aea7-ab3c-4727-99a9-bf48eef21703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:02:45.671697 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1aea7-ab3c-4727-99a9-bf48eef21703 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:45.671831 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1aea7-ab3c-4727-99a9-bf48eef21703 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:45.672005 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1aea7-ab3c-4727-99a9-bf48eef21703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:45.681959 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1aea7-ab3c-4727-99a9-bf48eef21703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:02:45.683404 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1aea7-ab3c-4727-99a9-bf48eef21703 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:02:45.693725 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 475/955] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:02:45 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:02:47.971941 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a2d47-1b28-49e6-8942-b1931e639631 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:47.972485 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a2d47-1b28-49e6-8942-b1931e639631 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:47.972485 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a2d47-1b28-49e6-8942-b1931e639631 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:47.973834 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 481/956] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:02:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:02:47.979339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d95a95-e28d-4fca-a114-ec2e04e141a7 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:47.979854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d95a95-e28d-4fca-a114-ec2e04e141a7 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:47.979963 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d95a95-e28d-4fca-a114-ec2e04e141a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:48.001591 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-33d95a95-e28d-4fca-a114-ec2e04e141a7 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:48.002849 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-33d95a95-e28d-4fca-a114-ec2e04e141a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:48.011100 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 476/957] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:02:47 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:02:48.352670 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a2d47-1b28-49e6-8942-b1931e639631 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:02:48.358003 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=65 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:02:48.386595 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a2d47-1b28-49e6-8942-b1931e639631 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:02:48.386595 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6e225-e121-4f1e-a773-b4b20aacce5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:02:48.386595 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6e225-e121-4f1e-a773-b4b20aacce5d service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:48.386595 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6e225-e121-4f1e-a773-b4b20aacce5d service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:48.387363 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6e225-e121-4f1e-a773-b4b20aacce5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:48.387363 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6e225-e121-4f1e-a773-b4b20aacce5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:02:48.387363 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6e225-e121-4f1e-a773-b4b20aacce5d service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:02:48.390465 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 482/958] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:02:48 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:02:51.350229 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de1373-b2c6-43cf-8ac7-a7f73c1fd508 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:51.350752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de1373-b2c6-43cf-8ac7-a7f73c1fd508 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:51.350752 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de1373-b2c6-43cf-8ac7-a7f73c1fd508 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:51.352140 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 477/959] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:02:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:02:51.357216 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008b0e7-976d-41f8-b5d3-74c44ce29317 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:51.357593 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008b0e7-976d-41f8-b5d3-74c44ce29317 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:51.357771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008b0e7-976d-41f8-b5d3-74c44ce29317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:51.377008 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-8008b0e7-976d-41f8-b5d3-74c44ce29317 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:51.378216 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-8008b0e7-976d-41f8-b5d3-74c44ce29317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:51.385994 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 483/960] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:02:51 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:02:51.729110 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de1373-b2c6-43cf-8ac7-a7f73c1fd508 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:02:51.739694 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de1373-b2c6-43cf-8ac7-a7f73c1fd508 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:02:51.743115 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cc4c2-b248-4921-8d93-b9f1f3a144d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:02:51.743695 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cc4c2-b248-4921-8d93-b9f1f3a144d2 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:51.743964 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cc4c2-b248-4921-8d93-b9f1f3a144d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:51.744231 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cc4c2-b248-4921-8d93-b9f1f3a144d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:51.753224 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cc4c2-b248-4921-8d93-b9f1f3a144d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:02:51.758645 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cc4c2-b248-4921-8d93-b9f1f3a144d2 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:02:51.764291 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 478/961] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:02:51 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:02:56.455115 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cdc1d-9398-48c3-9652-7c92f737dd0b None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:56.455669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cdc1d-9398-48c3-9652-7c92f737dd0b None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:56.455669 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cdc1d-9398-48c3-9652-7c92f737dd0b None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:56.457013 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 484/962] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:02:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:02:56.462273 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f66aa-5e2e-4a82-96dd-cbd5d4abb3d3 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:56.462707 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f66aa-5e2e-4a82-96dd-cbd5d4abb3d3 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:56.462969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f66aa-5e2e-4a82-96dd-cbd5d4abb3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:56.483133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-be7f66aa-5e2e-4a82-96dd-cbd5d4abb3d3 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:02:56.484345 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-be7f66aa-5e2e-4a82-96dd-cbd5d4abb3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:02:56.492468 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 479/963] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:02:56 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:02:56.842418 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cdc1d-9398-48c3-9652-7c92f737dd0b None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:02:56.853363 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cdc1d-9398-48c3-9652-7c92f737dd0b None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:02:56.861572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abfad9-aefc-46a6-a470-9c17eaf421fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:02:56.862226 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abfad9-aefc-46a6-a470-9c17eaf421fc service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:02:56.862500 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abfad9-aefc-46a6-a470-9c17eaf421fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:02:56.862769 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abfad9-aefc-46a6-a470-9c17eaf421fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:02:56.872302 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abfad9-aefc-46a6-a470-9c17eaf421fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:02:56.873730 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abfad9-aefc-46a6-a470-9c17eaf421fc service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:02:56.884199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 485/964] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:02:56 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:00.279446 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ef1bf-08ff-452a-98a5-610e6eaa836c None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:00.280024 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ef1bf-08ff-452a-98a5-610e6eaa836c None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:00.280024 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ef1bf-08ff-452a-98a5-610e6eaa836c None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:00.282078 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 480/965] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:00.287664 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bed23-24ce-4960-b85f-487728c4d5c1 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:00.288182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bed23-24ce-4960-b85f-487728c4d5c1 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:00.288281 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bed23-24ce-4960-b85f-487728c4d5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:00.308553 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-d36bed23-24ce-4960-b85f-487728c4d5c1 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:00.309754 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-d36bed23-24ce-4960-b85f-487728c4d5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:00.317771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 486/966] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:00 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:00.678762 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ef1bf-08ff-452a-98a5-610e6eaa836c None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:00.690091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ef1bf-08ff-452a-98a5-610e6eaa836c None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:00.693882 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b937638-e6ed-4cac-b991-0eb324310464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:00.697880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b937638-e6ed-4cac-b991-0eb324310464 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:00.697880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b937638-e6ed-4cac-b991-0eb324310464 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:00.697880 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b937638-e6ed-4cac-b991-0eb324310464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:00.706801 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b937638-e6ed-4cac-b991-0eb324310464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:00.708295 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b937638-e6ed-4cac-b991-0eb324310464 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:00.718956 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 481/967] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:00 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:05.297492 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaca983-cce5-46df-9cd7-6802986efbab None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:05.298079 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaca983-cce5-46df-9cd7-6802986efbab None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:05.298079 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaca983-cce5-46df-9cd7-6802986efbab None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:05.299766 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 487/968] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:05.305187 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed4acc-b7f5-4529-a3ea-24b0a2d0f48b None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:05.305542 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed4acc-b7f5-4529-a3ea-24b0a2d0f48b None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:05.305738 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed4acc-b7f5-4529-a3ea-24b0a2d0f48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:05.325719 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-b1ed4acc-b7f5-4529-a3ea-24b0a2d0f48b None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:05.329522 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-b1ed4acc-b7f5-4529-a3ea-24b0a2d0f48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:05.338105 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 482/969] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:05 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:05.684626 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaca983-cce5-46df-9cd7-6802986efbab None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:05.696011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaca983-cce5-46df-9cd7-6802986efbab None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:05.699941 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c56f2-332f-4195-a589-f4c47f2f372b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:05.700596 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c56f2-332f-4195-a589-f4c47f2f372b service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:05.700873 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c56f2-332f-4195-a589-f4c47f2f372b service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:05.701146 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c56f2-332f-4195-a589-f4c47f2f372b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:05.711279 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c56f2-332f-4195-a589-f4c47f2f372b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:05.712714 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c56f2-332f-4195-a589-f4c47f2f372b service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:05.723665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 488/970] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:05 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:11.349233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfd415-551b-4db9-9c10-a8da88dad643 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:11.349741 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfd415-551b-4db9-9c10-a8da88dad643 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:11.356322 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfd415-551b-4db9-9c10-a8da88dad643 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:11.356322 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 483/971] 10.222.0.121 () {54 vars in 926 bytes} [Fri Aug 26 01:03:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:11.356932 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb29f0-4da3-46d8-8f41-af5c6d9f5f3d None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:11.357432 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb29f0-4da3-46d8-8f41-af5c6d9f5f3d None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:11.357525 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb29f0-4da3-46d8-8f41-af5c6d9f5f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:11.416082 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-c2bb29f0-4da3-46d8-8f41-af5c6d9f5f3d None None] MFA Rules not processed for user `49070d8a078644f4a9e17deab052ba41`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:11.417581 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-c2bb29f0-4da3-46d8-8f41-af5c6d9f5f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:11.496106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 489/972] 10.222.0.121 () {58 vars in 1023 bytes} [Fri Aug 26 01:03:11 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:15.321274 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=25 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:16.147107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b146b-803a-4add-9b6b-9da0787d33e9 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:16.147507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b146b-803a-4add-9b6b-9da0787d33e9 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:16.147648 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b146b-803a-4add-9b6b-9da0787d33e9 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:16.149264 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 484/973] 10.222.0.121 () {54 vars in 926 bytes} [Fri Aug 26 01:03:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:16.154242 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43376bf7-6641-4a0d-8a40-193c3e05aa7f None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:16.154759 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43376bf7-6641-4a0d-8a40-193c3e05aa7f None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:16.154863 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43376bf7-6641-4a0d-8a40-193c3e05aa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:16.176898 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-43376bf7-6641-4a0d-8a40-193c3e05aa7f None None] MFA Rules not processed for user `49070d8a078644f4a9e17deab052ba41`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:16.178105 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-43376bf7-6641-4a0d-8a40-193c3e05aa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:16.188033 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 490/974] 10.222.0.121 () {58 vars in 1023 bytes} [Fri Aug 26 01:03:16 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:17.920515 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda25ffd-224f-4a8e-876a-34538329640c None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:17.921058 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda25ffd-224f-4a8e-876a-34538329640c None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:17.921058 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda25ffd-224f-4a8e-876a-34538329640c None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:17.923005 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 485/975] 10.222.0.121 () {54 vars in 926 bytes} [Fri Aug 26 01:03:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:17.929049 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561689b-083a-4694-9fc1-62bba184d241 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:17.929632 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561689b-083a-4694-9fc1-62bba184d241 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:17.929632 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561689b-083a-4694-9fc1-62bba184d241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:17.951339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-b561689b-083a-4694-9fc1-62bba184d241 None None] MFA Rules not processed for user `49070d8a078644f4a9e17deab052ba41`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:17.952599 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-b561689b-083a-4694-9fc1-62bba184d241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:17.961899 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 491/976] 10.222.0.121 () {58 vars in 1023 bytes} [Fri Aug 26 01:03:17 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:21.769282 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8cf3f-5c06-4b8d-a399-f09f12225b2a None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:21.769837 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8cf3f-5c06-4b8d-a399-f09f12225b2a None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:21.769837 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8cf3f-5c06-4b8d-a399-f09f12225b2a None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:21.772492 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 486/977] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:21.776687 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ab351-bdd2-4bf9-b7e2-592a613323a0 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:21.777450 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ab351-bdd2-4bf9-b7e2-592a613323a0 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:21.777450 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ab351-bdd2-4bf9-b7e2-592a613323a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:21.787120 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=69 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:21.803373 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-c73ab351-bdd2-4bf9-b7e2-592a613323a0 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:21.804604 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-c73ab351-bdd2-4bf9-b7e2-592a613323a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:21.815752 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 492/978] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:21 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:22.192397 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53107128-e456-45e2-b674-f2b250f8ac71 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:22.193019 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53107128-e456-45e2-b674-f2b250f8ac71 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:22.193545 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53107128-e456-45e2-b674-f2b250f8ac71 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:22.195697 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 487/979] 10.222.0.121 () {54 vars in 967 bytes} [Fri Aug 26 01:03:22 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:22.205723 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e36532-8cb5-43b3-aa22-93f739cab667 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:22.206877 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e36532-8cb5-43b3-aa22-93f739cab667 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:22.207552 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e36532-8cb5-43b3-aa22-93f739cab667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:22.264024 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-10e36532-8cb5-43b3-aa22-93f739cab667 None None] MFA Rules not processed for user `9a64697b77c04100934d5bd91cb321ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:22.265908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-10e36532-8cb5-43b3-aa22-93f739cab667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:22.355220 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 493/980] 10.222.0.121 () {58 vars in 1064 bytes} [Fri Aug 26 01:03:22 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:03:22.363889 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53107128-e456-45e2-b674-f2b250f8ac71 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:22.379129 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53107128-e456-45e2-b674-f2b250f8ac71 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:22.385915 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a9610-669b-44a7-bd09-4965f204522f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:22.386637 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a9610-669b-44a7-bd09-4965f204522f service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:22.387021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a9610-669b-44a7-bd09-4965f204522f service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:22.387484 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a9610-669b-44a7-bd09-4965f204522f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:22.398186 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a9610-669b-44a7-bd09-4965f204522f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:22.400207 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a9610-669b-44a7-bd09-4965f204522f service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:22.414309 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 488/981] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:22 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:03:24.918935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224bb02-e42c-426a-944c-0301a4d86dd9 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:24.919496 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224bb02-e42c-426a-944c-0301a4d86dd9 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:24.919496 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224bb02-e42c-426a-944c-0301a4d86dd9 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:24.920796 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 494/982] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:24.926671 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ded73-3e1b-4295-9d7c-d7649ab35818 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:24.927142 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ded73-3e1b-4295-9d7c-d7649ab35818 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:24.927264 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ded73-3e1b-4295-9d7c-d7649ab35818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:24.947135 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-cb8ded73-3e1b-4295-9d7c-d7649ab35818 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:24.948336 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-cb8ded73-3e1b-4295-9d7c-d7649ab35818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:24.956614 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 489/983] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:24 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:03:25.306338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224bb02-e42c-426a-944c-0301a4d86dd9 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:25.320468 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224bb02-e42c-426a-944c-0301a4d86dd9 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:25.325800 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52d32e-e2a1-4c49-b04e-6aa9a04074d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:25.326505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52d32e-e2a1-4c49-b04e-6aa9a04074d5 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:25.326976 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52d32e-e2a1-4c49-b04e-6aa9a04074d5 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:25.327995 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52d32e-e2a1-4c49-b04e-6aa9a04074d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:25.337611 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52d32e-e2a1-4c49-b04e-6aa9a04074d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:25.339397 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52d32e-e2a1-4c49-b04e-6aa9a04074d5 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:25.351128 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 495/984] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:25 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:28.092313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304cd90-d8f9-469e-8ae1-c20304c51aba None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:28.092827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304cd90-d8f9-469e-8ae1-c20304c51aba None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:28.092827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304cd90-d8f9-469e-8ae1-c20304c51aba None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:28.094705 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 490/985] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:28.100124 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f60d4-54b1-4526-9eb7-44dc7ef65c2c None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:28.101030 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f60d4-54b1-4526-9eb7-44dc7ef65c2c None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:28.101401 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f60d4-54b1-4526-9eb7-44dc7ef65c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:28.121253 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-cd6f60d4-54b1-4526-9eb7-44dc7ef65c2c None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:28.122461 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-cd6f60d4-54b1-4526-9eb7-44dc7ef65c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:28.130260 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 496/986] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:28 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:28.488264 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64416257-f303-411f-9f8a-57091555448c None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:28.488870 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64416257-f303-411f-9f8a-57091555448c None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:28.489377 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64416257-f303-411f-9f8a-57091555448c None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:28.490885 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 491/987] 10.222.0.121 () {54 vars in 967 bytes} [Fri Aug 26 01:03:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:28.497501 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476df5-7169-40a5-ba5c-7cfe119ecd3a None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:28.497791 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476df5-7169-40a5-ba5c-7cfe119ecd3a None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:28.498071 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3476df5-7169-40a5-ba5c-7cfe119ecd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:28.526139 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-d3476df5-7169-40a5-ba5c-7cfe119ecd3a None None] MFA Rules not processed for user `9a64697b77c04100934d5bd91cb321ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:28.527537 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-d3476df5-7169-40a5-ba5c-7cfe119ecd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:28.537435 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 497/988] 10.222.0.121 () {58 vars in 1064 bytes} [Fri Aug 26 01:03:28 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:28.545387 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64416257-f303-411f-9f8a-57091555448c None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:28.564221 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64416257-f303-411f-9f8a-57091555448c None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:28.570136 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852c25c-d2e5-4d65-969f-252f09019150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:28.570893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852c25c-d2e5-4d65-969f-252f09019150 service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:28.571246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852c25c-d2e5-4d65-969f-252f09019150 service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:28.572091 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852c25c-d2e5-4d65-969f-252f09019150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:28.581536 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852c25c-d2e5-4d65-969f-252f09019150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:28.583328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852c25c-d2e5-4d65-969f-252f09019150 service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:28.596774 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 492/989] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:28 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:31.220416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02f5bb-d963-4029-8590-5b062a981b5a None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:31.221433 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02f5bb-d963-4029-8590-5b062a981b5a None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:31.221993 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02f5bb-d963-4029-8590-5b062a981b5a None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:31.240175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19e9b9-5ab8-456b-a07f-801e68c4a1c2 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:31.241678 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19e9b9-5ab8-456b-a07f-801e68c4a1c2 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:31.242417 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19e9b9-5ab8-456b-a07f-801e68c4a1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:31.247638 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 498/990] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:31 2022] GET /identity => generated 271 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:31.273334 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-ee19e9b9-5ab8-456b-a07f-801e68c4a1c2 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:31.276411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-ee19e9b9-5ab8-456b-a07f-801e68c4a1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:31.295257 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 493/991] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:31 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:31.677867 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02f5bb-d963-4029-8590-5b062a981b5a None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:31.704355 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02f5bb-d963-4029-8590-5b062a981b5a None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:31.711018 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7dd73-3540-453a-9ea6-3eb98d373dd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:31.712027 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7dd73-3540-453a-9ea6-3eb98d373dd1 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:31.712533 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7dd73-3540-453a-9ea6-3eb98d373dd1 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:31.713033 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7dd73-3540-453a-9ea6-3eb98d373dd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:31.724567 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7dd73-3540-453a-9ea6-3eb98d373dd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:31.728308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7dd73-3540-453a-9ea6-3eb98d373dd1 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:31.757066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 499/992] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:31 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:32.336121 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75ed77-e1a9-43bb-b591-f888ef130887 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:32.336557 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75ed77-e1a9-43bb-b591-f888ef130887 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:32.336766 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75ed77-e1a9-43bb-b591-f888ef130887 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:32.338038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 494/993] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:32.345044 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0220c8-36f6-4ad7-9640-2278657dab0f None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:32.346275 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0220c8-36f6-4ad7-9640-2278657dab0f None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:32.347126 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0220c8-36f6-4ad7-9640-2278657dab0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:32.400406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-bb0220c8-36f6-4ad7-9640-2278657dab0f None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:32.400406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-bb0220c8-36f6-4ad7-9640-2278657dab0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:32.434494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 500/994] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:32 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:33.048490 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063d856-8906-4b33-9ed9-6f02fc10c3ad None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:33.048490 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063d856-8906-4b33-9ed9-6f02fc10c3ad None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:33.048490 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063d856-8906-4b33-9ed9-6f02fc10c3ad None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:33.049578 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 495/995] 10.222.0.121 () {54 vars in 969 bytes} [Fri Aug 26 01:03:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:33.053789 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890eb0d-385f-4784-bcaa-ec5df5975cbe None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:33.054076 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890eb0d-385f-4784-bcaa-ec5df5975cbe None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:33.054346 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890eb0d-385f-4784-bcaa-ec5df5975cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:33.111825 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-0890eb0d-385f-4784-bcaa-ec5df5975cbe None None] MFA Rules not processed for user `b48c6b8ef7284907bbfd5b48e2b58516`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:33.113146 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-0890eb0d-385f-4784-bcaa-ec5df5975cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:33.162256 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=100 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:33.180051 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 501/996] 10.222.0.121 () {58 vars in 1066 bytes} [Fri Aug 26 01:03:33 2022] POST /identity/v3/auth/tokens => generated 2688 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:33.187437 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063d856-8906-4b33-9ed9-6f02fc10c3ad None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:33.199473 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063d856-8906-4b33-9ed9-6f02fc10c3ad None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:33.203945 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c05645-75c8-49f3-aadd-5be38c0f43be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48c6b8ef7284907bbfd5b48e2b58516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:33.204878 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c05645-75c8-49f3-aadd-5be38c0f43be service cinder] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:33.205316 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c05645-75c8-49f3-aadd-5be38c0f43be service cinder] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:33.205732 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c05645-75c8-49f3-aadd-5be38c0f43be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:33.217108 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c05645-75c8-49f3-aadd-5be38c0f43be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:33.219432 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c05645-75c8-49f3-aadd-5be38c0f43be service cinder] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:33.229661 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 496/997] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:33 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:34.338576 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359ce3-8879-4067-89c8-b5670536133e None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:34.339010 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359ce3-8879-4067-89c8-b5670536133e None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:34.339259 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359ce3-8879-4067-89c8-b5670536133e None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:34.340663 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 502/998] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:34.346475 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29338327-4012-4910-b648-f17c0609f6c4 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:34.346913 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29338327-4012-4910-b648-f17c0609f6c4 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:34.347096 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29338327-4012-4910-b648-f17c0609f6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:34.366680 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-29338327-4012-4910-b648-f17c0609f6c4 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:34.371184 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-29338327-4012-4910-b648-f17c0609f6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:34.377382 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 497/999] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:34 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:34.733381 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff359ce3-8879-4067-89c8-b5670536133e None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:34.756498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff359ce3-8879-4067-89c8-b5670536133e None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:34.762270 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49616a6-45b9-4d56-8526-fadbd60a6b29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:34.763145 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49616a6-45b9-4d56-8526-fadbd60a6b29 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:34.763955 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49616a6-45b9-4d56-8526-fadbd60a6b29 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:34.764473 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49616a6-45b9-4d56-8526-fadbd60a6b29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:34.774511 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49616a6-45b9-4d56-8526-fadbd60a6b29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:34.776487 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49616a6-45b9-4d56-8526-fadbd60a6b29 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:34.789514 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 503/1000] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:34 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:37.298276 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78118f-4241-42d8-99b4-29f1f06d4fb0 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:37.298276 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78118f-4241-42d8-99b4-29f1f06d4fb0 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:37.298276 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78118f-4241-42d8-99b4-29f1f06d4fb0 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:37.302000 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 498/1001] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:37 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:37.306909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06992303-5af7-4336-84a0-cba043a4b71d None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:37.308023 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06992303-5af7-4336-84a0-cba043a4b71d None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:37.309419 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06992303-5af7-4336-84a0-cba043a4b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:37.345667 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-06992303-5af7-4336-84a0-cba043a4b71d None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:37.346930 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-06992303-5af7-4336-84a0-cba043a4b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:37.358976 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 504/1002] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:37 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:37.718957 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78118f-4241-42d8-99b4-29f1f06d4fb0 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:37.733359 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78118f-4241-42d8-99b4-29f1f06d4fb0 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:37.738566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4889c4b-aaee-41c1-a899-aa611390d8ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:37.739315 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4889c4b-aaee-41c1-a899-aa611390d8ae service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:37.739906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4889c4b-aaee-41c1-a899-aa611390d8ae service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:37.740290 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4889c4b-aaee-41c1-a899-aa611390d8ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:37.750507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4889c4b-aaee-41c1-a899-aa611390d8ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:37.752365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4889c4b-aaee-41c1-a899-aa611390d8ae service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:37.764098 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 499/1003] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:37 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:40.225231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e47d61-bfbb-4902-9546-4e3e949a2fea None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:40.225231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e47d61-bfbb-4902-9546-4e3e949a2fea None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:40.225858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e47d61-bfbb-4902-9546-4e3e949a2fea None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:40.226878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 505/1004] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:40.233528 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112f6d4-1623-4986-89be-95789b7a80ff None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:40.234642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112f6d4-1623-4986-89be-95789b7a80ff None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:40.234642 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112f6d4-1623-4986-89be-95789b7a80ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:40.256665 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-5112f6d4-1623-4986-89be-95789b7a80ff None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:40.257964 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-5112f6d4-1623-4986-89be-95789b7a80ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:40.266200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 500/1005] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:40 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:40.615106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e47d61-bfbb-4902-9546-4e3e949a2fea None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:40.631366 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e47d61-bfbb-4902-9546-4e3e949a2fea None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:40.636777 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a0fa8-7e79-4e10-84fb-3c81ccaea057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:40.637604 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a0fa8-7e79-4e10-84fb-3c81ccaea057 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:40.638031 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a0fa8-7e79-4e10-84fb-3c81ccaea057 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:40.638450 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a0fa8-7e79-4e10-84fb-3c81ccaea057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:40.648129 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a0fa8-7e79-4e10-84fb-3c81ccaea057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:40.649936 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a0fa8-7e79-4e10-84fb-3c81ccaea057 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:40.660456 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 506/1006] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:40 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:43.146459 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316b6f9-afe1-42fc-b8da-bf685c260507 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:43.146459 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316b6f9-afe1-42fc-b8da-bf685c260507 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:43.146459 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316b6f9-afe1-42fc-b8da-bf685c260507 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:43.146459 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 501/1007] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:43.154779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a83ede-b375-4047-bde2-34d08e559ae8 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:43.154779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a83ede-b375-4047-bde2-34d08e559ae8 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:43.154779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a83ede-b375-4047-bde2-34d08e559ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:43.154779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-b6a83ede-b375-4047-bde2-34d08e559ae8 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:43.154779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-b6a83ede-b375-4047-bde2-34d08e559ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:43.154779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 507/1008] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:43 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:43.445334 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316b6f9-afe1-42fc-b8da-bf685c260507 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:43.445334 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316b6f9-afe1-42fc-b8da-bf685c260507 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:43.449472 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb5aa3-31c6-49ed-b648-fbdd8dd993e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:43.450120 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb5aa3-31c6-49ed-b648-fbdd8dd993e7 service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:43.450427 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb5aa3-31c6-49ed-b648-fbdd8dd993e7 service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:43.450701 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb5aa3-31c6-49ed-b648-fbdd8dd993e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:43.459878 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb5aa3-31c6-49ed-b648-fbdd8dd993e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:43.461643 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb5aa3-31c6-49ed-b648-fbdd8dd993e7 service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:43.472046 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 502/1009] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:43 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:48.101951 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644d404-50f6-46ef-b3f3-245f36ff07d2 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:48.102714 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644d404-50f6-46ef-b3f3-245f36ff07d2 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:48.102714 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644d404-50f6-46ef-b3f3-245f36ff07d2 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:48.103863 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 508/1010] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:48.109497 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee716c-6098-4ed6-9669-1c3a61ebe199 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:48.110012 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee716c-6098-4ed6-9669-1c3a61ebe199 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:48.110012 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee716c-6098-4ed6-9669-1c3a61ebe199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:48.117518 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=43 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:03:48.130637 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-b0ee716c-6098-4ed6-9669-1c3a61ebe199 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:48.131893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-b0ee716c-6098-4ed6-9669-1c3a61ebe199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:48.139741 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 503/1011] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:48 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:48.492884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644d404-50f6-46ef-b3f3-245f36ff07d2 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:48.507239 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644d404-50f6-46ef-b3f3-245f36ff07d2 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:48.512346 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972552d7-4a9f-40a8-837b-7c422634b181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:48.512982 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972552d7-4a9f-40a8-837b-7c422634b181 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:48.513262 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972552d7-4a9f-40a8-837b-7c422634b181 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:48.513535 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972552d7-4a9f-40a8-837b-7c422634b181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:48.522291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972552d7-4a9f-40a8-837b-7c422634b181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:48.523901 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972552d7-4a9f-40a8-837b-7c422634b181 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:48.534328 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 509/1012] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:48 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:50.018088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d0155-ff8e-42e9-a599-2e22927fdf05 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:50.018653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d0155-ff8e-42e9-a599-2e22927fdf05 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:50.018653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d0155-ff8e-42e9-a599-2e22927fdf05 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:50.019922 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 504/1013] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:50.025216 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e898f4-5177-4f15-900f-0725b7fd1627 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:50.025657 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e898f4-5177-4f15-900f-0725b7fd1627 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:50.025857 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e898f4-5177-4f15-900f-0725b7fd1627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:50.054986 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-05e898f4-5177-4f15-900f-0725b7fd1627 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:50.056194 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-05e898f4-5177-4f15-900f-0725b7fd1627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:50.064870 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 510/1014] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:50 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:50.428283 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5e94f-8fb9-4527-a869-be832f81553a None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:50.428640 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5e94f-8fb9-4527-a869-be832f81553a None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:50.428921 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5e94f-8fb9-4527-a869-be832f81553a None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:50.430254 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 505/1015] 10.222.0.121 () {54 vars in 972 bytes} [Fri Aug 26 01:03:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:50.435525 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f541e06-3290-4086-80a9-e87165af83e3 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:50.435878 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f541e06-3290-4086-80a9-e87165af83e3 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:50.436272 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f541e06-3290-4086-80a9-e87165af83e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:50.487959 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-9f541e06-3290-4086-80a9-e87165af83e3 None None] MFA Rules not processed for user `4fe450e040874be58ea27dd47c3ff7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:50.489165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-9f541e06-3290-4086-80a9-e87165af83e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:50.556140 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 511/1016] 10.222.0.121 () {58 vars in 1069 bytes} [Fri Aug 26 01:03:50 2022] POST /identity/v3/auth/tokens => generated 2688 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:50.563889 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5e94f-8fb9-4527-a869-be832f81553a None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:50.576289 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5e94f-8fb9-4527-a869-be832f81553a None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:50.580565 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d904c2a-d550-4754-aef9-c90c179c5c1a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe450e040874be58ea27dd47c3ff7a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:50.581362 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d904c2a-d550-4754-aef9-c90c179c5c1a service glance] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:50.581737 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d904c2a-d550-4754-aef9-c90c179c5c1a service glance] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:50.582225 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d904c2a-d550-4754-aef9-c90c179c5c1a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:50.591714 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d904c2a-d550-4754-aef9-c90c179c5c1a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:50.593148 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d904c2a-d550-4754-aef9-c90c179c5c1a service glance] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:50.603122 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 506/1017] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:50 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:03:50.925386 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef73f7-1ce2-4f3d-97cc-69e0656afd30 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:50.925605 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef73f7-1ce2-4f3d-97cc-69e0656afd30 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:50.925877 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef73f7-1ce2-4f3d-97cc-69e0656afd30 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:50.927260 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 512/1018] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:50.932817 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa293d85-c401-4b1b-b4aa-6883a4180722 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:50.938319 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa293d85-c401-4b1b-b4aa-6883a4180722 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:50.938319 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa293d85-c401-4b1b-b4aa-6883a4180722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:50.954475 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-fa293d85-c401-4b1b-b4aa-6883a4180722 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:50.955732 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-fa293d85-c401-4b1b-b4aa-6883a4180722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:50.963814 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 507/1019] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:50 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:51.328342 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef73f7-1ce2-4f3d-97cc-69e0656afd30 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:51.341832 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef73f7-1ce2-4f3d-97cc-69e0656afd30 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:51.347288 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a9590-606c-473a-8b0a-c44be64c820e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:51.347887 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a9590-606c-473a-8b0a-c44be64c820e service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:51.348160 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a9590-606c-473a-8b0a-c44be64c820e service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:51.348433 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a9590-606c-473a-8b0a-c44be64c820e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:51.356614 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a9590-606c-473a-8b0a-c44be64c820e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:51.358198 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a9590-606c-473a-8b0a-c44be64c820e service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:51.368702 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 513/1020] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:51 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:54.649904 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1db81b-93ce-4304-b95e-e1f1610dc9f4 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:54.649904 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1db81b-93ce-4304-b95e-e1f1610dc9f4 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:54.649904 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1db81b-93ce-4304-b95e-e1f1610dc9f4 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:54.649904 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 508/1021] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:54.655410 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2d76b-f2d8-453c-a67c-c1c384e79406 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:54.655939 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2d76b-f2d8-453c-a67c-c1c384e79406 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:54.656040 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2d76b-f2d8-453c-a67c-c1c384e79406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:54.681081 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-08c2d76b-f2d8-453c-a67c-c1c384e79406 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:54.682338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-08c2d76b-f2d8-453c-a67c-c1c384e79406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:54.690998 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 514/1022] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:54 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:55.042394 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1db81b-93ce-4304-b95e-e1f1610dc9f4 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:55.057875 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1db81b-93ce-4304-b95e-e1f1610dc9f4 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:55.067482 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fc399-a030-4143-8a0f-b13ba530c7d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:55.067482 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc399-a030-4143-8a0f-b13ba530c7d1 service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:55.067482 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc399-a030-4143-8a0f-b13ba530c7d1 service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:55.067482 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc399-a030-4143-8a0f-b13ba530c7d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:55.078206 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fc399-a030-4143-8a0f-b13ba530c7d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:55.079830 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fc399-a030-4143-8a0f-b13ba530c7d1 service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:55.090168 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 509/1023] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:55 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:03:57.699366 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659de38f-0d60-4d52-95b7-c43dce33a135 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:57.700001 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659de38f-0d60-4d52-95b7-c43dce33a135 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:57.700001 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659de38f-0d60-4d52-95b7-c43dce33a135 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:57.701265 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 515/1024] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:03:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:03:57.706934 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0a5bd-ef8e-4711-ab0d-26974d7014ab None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:57.707421 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0a5bd-ef8e-4711-ab0d-26974d7014ab None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:57.707530 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0a5bd-ef8e-4711-ab0d-26974d7014ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:57.727578 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-42c0a5bd-ef8e-4711-ab0d-26974d7014ab None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:03:57.736359 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-42c0a5bd-ef8e-4711-ab0d-26974d7014ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:03:57.744705 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 510/1025] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:03:57 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:03:58.096725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659de38f-0d60-4d52-95b7-c43dce33a135 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:03:58.111419 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659de38f-0d60-4d52-95b7-c43dce33a135 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:03:58.116515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7f2ef-518d-4255-ac47-f113c93713f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:03:58.117238 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7f2ef-518d-4255-ac47-f113c93713f5 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:03:58.117527 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7f2ef-518d-4255-ac47-f113c93713f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:03:58.117800 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7f2ef-518d-4255-ac47-f113c93713f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:03:58.126660 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7f2ef-518d-4255-ac47-f113c93713f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:03:58.128285 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7f2ef-518d-4255-ac47-f113c93713f5 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:03:58.140083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 516/1026] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:03:58 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:07.499722 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa728b-0da3-4298-b89b-94d73f4775dc None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:07.500329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa728b-0da3-4298-b89b-94d73f4775dc None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:07.500329 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa728b-0da3-4298-b89b-94d73f4775dc None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:07.501577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 511/1027] 10.222.0.121 () {54 vars in 923 bytes} [Fri Aug 26 01:04:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:07.506799 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbea90-eb1e-4110-8912-f9db2cfe0e7f None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:07.507287 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbea90-eb1e-4110-8912-f9db2cfe0e7f None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:07.507393 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbea90-eb1e-4110-8912-f9db2cfe0e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:07.515170 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=86 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:07.543023 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-87cbea90-eb1e-4110-8912-f9db2cfe0e7f None None] MFA Rules not processed for user `49070d8a078644f4a9e17deab052ba41`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:07.544303 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-87cbea90-eb1e-4110-8912-f9db2cfe0e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:07.557025 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 517/1028] 10.222.0.121 () {58 vars in 1020 bytes} [Fri Aug 26 01:04:07 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:07.572038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb68fa-d8cb-4e67-af35-60b2467f0b7a None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:07.572337 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb68fa-d8cb-4e67-af35-60b2467f0b7a None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:07.572600 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb68fa-d8cb-4e67-af35-60b2467f0b7a None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:07.574245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 512/1029] 10.222.0.121 () {54 vars in 923 bytes} [Fri Aug 26 01:04:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:07.579867 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdbea6-9afc-465c-b090-c64e17350857 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:07.580365 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdbea6-9afc-465c-b090-c64e17350857 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:07.580649 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdbea6-9afc-465c-b090-c64e17350857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:07.599986 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-2cbdbea6-9afc-465c-b090-c64e17350857 None None] MFA Rules not processed for user `9a64697b77c04100934d5bd91cb321ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:07.601203 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-2cbdbea6-9afc-465c-b090-c64e17350857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:07.609790 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 518/1030] 10.222.0.121 () {58 vars in 1020 bytes} [Fri Aug 26 01:04:07 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:07.722529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=20 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:10.341459 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e190ba-dd62-4bff-9bf5-8fdf7c94b35c None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:10.342623 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e190ba-dd62-4bff-9bf5-8fdf7c94b35c None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:10.342623 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e190ba-dd62-4bff-9bf5-8fdf7c94b35c None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:10.343681 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 513/1031] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:04:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:10.349359 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb222b5-2140-4d52-89e2-15f87ae327ab None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:10.349879 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb222b5-2140-4d52-89e2-15f87ae327ab None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:10.349879 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb222b5-2140-4d52-89e2-15f87ae327ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:10.370063 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-dfb222b5-2140-4d52-89e2-15f87ae327ab None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:10.371339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-dfb222b5-2140-4d52-89e2-15f87ae327ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:10.381801 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 519/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:04:10 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:10.735245 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e190ba-dd62-4bff-9bf5-8fdf7c94b35c None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:10.748692 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e190ba-dd62-4bff-9bf5-8fdf7c94b35c None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:10.754672 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8bfc4-3bb5-4327-bf92-b88cf155e4a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:10.755402 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8bfc4-3bb5-4327-bf92-b88cf155e4a7 service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:10.755676 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8bfc4-3bb5-4327-bf92-b88cf155e4a7 service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:10.755944 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8bfc4-3bb5-4327-bf92-b88cf155e4a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:10.764924 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8bfc4-3bb5-4327-bf92-b88cf155e4a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:10.767128 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8bfc4-3bb5-4327-bf92-b88cf155e4a7 service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:10.776829 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 514/1033] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:10 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:04:11.749430 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4255d-031c-4c19-a31c-32da39ad5583 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:11.750064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4255d-031c-4c19-a31c-32da39ad5583 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:11.750064 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4255d-031c-4c19-a31c-32da39ad5583 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:11.751906 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 520/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:04:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:11.756938 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a9177-a311-498a-bd76-de00070f466c None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:11.757361 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a9177-a311-498a-bd76-de00070f466c None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:11.763160 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a9177-a311-498a-bd76-de00070f466c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:11.777511 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-961a9177-a311-498a-bd76-de00070f466c None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:11.778700 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-961a9177-a311-498a-bd76-de00070f466c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:11.787463 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 515/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:04:11 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:12.040393 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4255d-031c-4c19-a31c-32da39ad5583 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:12.054285 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4255d-031c-4c19-a31c-32da39ad5583 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:12.059420 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0af01-e63e-4600-8b0d-6114da890b70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:12.060016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0af01-e63e-4600-8b0d-6114da890b70 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:12.060297 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0af01-e63e-4600-8b0d-6114da890b70 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:12.060569 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0af01-e63e-4600-8b0d-6114da890b70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:12.069648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0af01-e63e-4600-8b0d-6114da890b70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:12.071263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0af01-e63e-4600-8b0d-6114da890b70 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:12.081555 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 521/1036] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:12 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:13.003131 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a366bb-b870-4163-b877-e9ed69882164 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:13.003693 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a366bb-b870-4163-b877-e9ed69882164 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:13.003693 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a366bb-b870-4163-b877-e9ed69882164 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:13.005010 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 516/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:04:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:13.010143 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ecc8c-b24f-48d6-b6ed-48152df9ecbd None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:13.015277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ecc8c-b24f-48d6-b6ed-48152df9ecbd None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:13.015277 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ecc8c-b24f-48d6-b6ed-48152df9ecbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:13.031044 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-236ecc8c-b24f-48d6-b6ed-48152df9ecbd None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:13.032297 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-236ecc8c-b24f-48d6-b6ed-48152df9ecbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:13.040488 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 522/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:04:13 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:13.197438 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a366bb-b870-4163-b877-e9ed69882164 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:13.211627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a366bb-b870-4163-b877-e9ed69882164 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:13.216514 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4e1a1-1068-4bb7-a76b-d203b28c651d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:13.217102 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4e1a1-1068-4bb7-a76b-d203b28c651d service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:13.217378 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4e1a1-1068-4bb7-a76b-d203b28c651d service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:13.217647 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4e1a1-1068-4bb7-a76b-d203b28c651d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:13.226125 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4e1a1-1068-4bb7-a76b-d203b28c651d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:13.227739 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4e1a1-1068-4bb7-a76b-d203b28c651d service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:13.238081 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 517/1039] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:13 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:14.120048 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f4591-b436-4626-8958-516f67dd8a91 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:14.120592 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f4591-b436-4626-8958-516f67dd8a91 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:14.120592 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f4591-b436-4626-8958-516f67dd8a91 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:14.122090 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 523/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:04:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:14.128395 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536af53-126f-463f-b171-2490e85e91be None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:14.128900 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536af53-126f-463f-b171-2490e85e91be None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:14.128997 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536af53-126f-463f-b171-2490e85e91be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:14.151713 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-e536af53-126f-463f-b171-2490e85e91be None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:14.154030 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-e536af53-126f-463f-b171-2490e85e91be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:14.163269 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 518/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:04:14 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:14.319550 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f4591-b436-4626-8958-516f67dd8a91 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:14.333746 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f4591-b436-4626-8958-516f67dd8a91 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:14.338860 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841aef56-daf7-4ba2-a0b3-5b1203769054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:14.339933 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aef56-daf7-4ba2-a0b3-5b1203769054 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:14.339933 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aef56-daf7-4ba2-a0b3-5b1203769054 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:14.340124 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841aef56-daf7-4ba2-a0b3-5b1203769054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:14.348705 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841aef56-daf7-4ba2-a0b3-5b1203769054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:14.350292 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841aef56-daf7-4ba2-a0b3-5b1203769054 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:14.360175 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 524/1042] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:14 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:15.234691 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484674f5-52e0-4209-a374-a0e581340389 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:15.235363 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484674f5-52e0-4209-a374-a0e581340389 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:15.235363 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484674f5-52e0-4209-a374-a0e581340389 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:15.236611 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 519/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:04:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:15.241631 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01758fa-0d27-4ec3-aa7d-bbb8994e0ff9 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:15.242026 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01758fa-0d27-4ec3-aa7d-bbb8994e0ff9 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:15.242185 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01758fa-0d27-4ec3-aa7d-bbb8994e0ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:15.262291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-d01758fa-0d27-4ec3-aa7d-bbb8994e0ff9 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:15.263541 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-d01758fa-0d27-4ec3-aa7d-bbb8994e0ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:15.271991 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 525/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:04:15 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:15.430042 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484674f5-52e0-4209-a374-a0e581340389 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:15.443837 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484674f5-52e0-4209-a374-a0e581340389 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:15.448959 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59982c08-d94c-4ec9-937f-465aa95b0f7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:15.449598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59982c08-d94c-4ec9-937f-465aa95b0f7a service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:15.449897 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59982c08-d94c-4ec9-937f-465aa95b0f7a service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:15.450130 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59982c08-d94c-4ec9-937f-465aa95b0f7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:15.459365 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59982c08-d94c-4ec9-937f-465aa95b0f7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:15.460962 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59982c08-d94c-4ec9-937f-465aa95b0f7a service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:15.470391 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 520/1045] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:15 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:16.400268 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b7cf0-327a-4032-9849-71209c7b3474 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:16.400948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b7cf0-327a-4032-9849-71209c7b3474 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:16.400948 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b7cf0-327a-4032-9849-71209c7b3474 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:16.402302 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 526/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:04:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:16.407341 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819eb12-3bd4-4a1b-bf73-035cdd4e115e None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:16.407750 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819eb12-3bd4-4a1b-bf73-035cdd4e115e None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:16.407903 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819eb12-3bd4-4a1b-bf73-035cdd4e115e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:16.428263 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-4819eb12-3bd4-4a1b-bf73-035cdd4e115e None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:16.429462 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-4819eb12-3bd4-4a1b-bf73-035cdd4e115e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:16.437141 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 521/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:04:16 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:16.610258 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b7cf0-327a-4032-9849-71209c7b3474 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:16.624619 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b7cf0-327a-4032-9849-71209c7b3474 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:16.629532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0518e-5274-4dc0-9f74-27efab9d0d27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:16.632213 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0518e-5274-4dc0-9f74-27efab9d0d27 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:16.632213 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0518e-5274-4dc0-9f74-27efab9d0d27 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:16.632213 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0518e-5274-4dc0-9f74-27efab9d0d27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:16.638675 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0518e-5274-4dc0-9f74-27efab9d0d27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:16.640276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0518e-5274-4dc0-9f74-27efab9d0d27 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:16.649915 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 527/1048] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:16 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:17.548527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0fd50-90fa-466f-9b63-22722ca5ef9f None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:17.549055 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0fd50-90fa-466f-9b63-22722ca5ef9f None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:17.549055 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0fd50-90fa-466f-9b63-22722ca5ef9f None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:17.550380 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 522/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:04:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:17.556002 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42425957-8261-408c-8d5c-1638d586298a None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:17.556440 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42425957-8261-408c-8d5c-1638d586298a None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:17.556548 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42425957-8261-408c-8d5c-1638d586298a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:17.576807 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-42425957-8261-408c-8d5c-1638d586298a None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:17.578601 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-42425957-8261-408c-8d5c-1638d586298a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:17.591937 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 528/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:04:17 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:04:17.752854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0fd50-90fa-466f-9b63-22722ca5ef9f None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:17.765963 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0fd50-90fa-466f-9b63-22722ca5ef9f None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:17.770855 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3603b7-11aa-413c-ba9b-834c0214963c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:17.771446 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3603b7-11aa-413c-ba9b-834c0214963c service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:17.771719 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3603b7-11aa-413c-ba9b-834c0214963c service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:17.771984 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3603b7-11aa-413c-ba9b-834c0214963c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:17.780223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3603b7-11aa-413c-ba9b-834c0214963c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:17.781836 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3603b7-11aa-413c-ba9b-834c0214963c service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:17.791540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 523/1051] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:17 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:18.693271 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507adb0f-1f84-48ef-90fa-3db27b2ab2bb None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:18.693799 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507adb0f-1f84-48ef-90fa-3db27b2ab2bb None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:18.693799 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507adb0f-1f84-48ef-90fa-3db27b2ab2bb None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:18.694951 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 529/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:04:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:18.700172 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63281590-f71c-4366-8ce2-37edc7474f71 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:18.700614 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63281590-f71c-4366-8ce2-37edc7474f71 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:18.700746 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63281590-f71c-4366-8ce2-37edc7474f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:18.721034 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-63281590-f71c-4366-8ce2-37edc7474f71 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:18.722256 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-63281590-f71c-4366-8ce2-37edc7474f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:18.730174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 524/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:04:18 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:18.887227 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507adb0f-1f84-48ef-90fa-3db27b2ab2bb None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:18.901214 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507adb0f-1f84-48ef-90fa-3db27b2ab2bb None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:18.906211 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0d9b8-215d-453d-9661-2c2049f5c373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:18.906799 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0d9b8-215d-453d-9661-2c2049f5c373 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:18.907110 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0d9b8-215d-453d-9661-2c2049f5c373 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:18.907384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0d9b8-215d-453d-9661-2c2049f5c373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:18.915583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0d9b8-215d-453d-9661-2c2049f5c373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:18.917166 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0d9b8-215d-453d-9661-2c2049f5c373 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:18.926579 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 530/1054] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:18 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:19.790834 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec51ae-dcb3-4b03-8446-ee7b4586008f None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:19.791391 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec51ae-dcb3-4b03-8446-ee7b4586008f None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:19.791391 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec51ae-dcb3-4b03-8446-ee7b4586008f None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:19.792754 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 525/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:04:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:19.798205 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f433b-e542-4e7e-9b14-30f2c2f2875f None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:19.798623 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f433b-e542-4e7e-9b14-30f2c2f2875f None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:19.798739 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f433b-e542-4e7e-9b14-30f2c2f2875f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:19.817813 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-9e2f433b-e542-4e7e-9b14-30f2c2f2875f None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:19.819038 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-9e2f433b-e542-4e7e-9b14-30f2c2f2875f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:19.827242 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 531/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:04:19 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:19.982100 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec51ae-dcb3-4b03-8446-ee7b4586008f None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:19.995639 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec51ae-dcb3-4b03-8446-ee7b4586008f None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:20.000492 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8912f72-eb65-47c5-a072-2f4265b98bbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:20.001073 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8912f72-eb65-47c5-a072-2f4265b98bbd service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:20.001347 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8912f72-eb65-47c5-a072-2f4265b98bbd service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:20.001613 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8912f72-eb65-47c5-a072-2f4265b98bbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:20.009634 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8912f72-eb65-47c5-a072-2f4265b98bbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:20.011256 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8912f72-eb65-47c5-a072-2f4265b98bbd service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:20.021135 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 526/1057] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:19 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:22.115823 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce030c7b-d935-4d12-ab8a-236ddac05849 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:22.116448 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce030c7b-d935-4d12-ab8a-236ddac05849 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:22.116448 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce030c7b-d935-4d12-ab8a-236ddac05849 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:22.117699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 532/1058] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:04:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:22.122974 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f32be6-19c5-4d65-8c57-12497a984bca None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:22.123391 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f32be6-19c5-4d65-8c57-12497a984bca None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:22.123510 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f32be6-19c5-4d65-8c57-12497a984bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:22.143483 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-61f32be6-19c5-4d65-8c57-12497a984bca None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:22.144693 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-61f32be6-19c5-4d65-8c57-12497a984bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:22.152513 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 527/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:04:22 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:22.506233 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce030c7b-d935-4d12-ab8a-236ddac05849 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:22.516780 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce030c7b-d935-4d12-ab8a-236ddac05849 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:22.520219 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa68c7-496b-4b11-ae72-6df2e9fa2a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:22.520899 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa68c7-496b-4b11-ae72-6df2e9fa2a66 service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:22.521176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa68c7-496b-4b11-ae72-6df2e9fa2a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:22.521439 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa68c7-496b-4b11-ae72-6df2e9fa2a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:22.531539 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa68c7-496b-4b11-ae72-6df2e9fa2a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:22.532999 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa68c7-496b-4b11-ae72-6df2e9fa2a66 service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:22.543002 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 533/1060] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:22 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:24.916125 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b26d37-ff7d-4045-91d6-b416cfe08d13 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:24.916694 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b26d37-ff7d-4045-91d6-b416cfe08d13 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:24.916694 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b26d37-ff7d-4045-91d6-b416cfe08d13 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:24.918044 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 528/1061] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:04:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:24.923954 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71e93b-a9bc-4e1a-a7fe-2fe87d958daf None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:24.924384 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71e93b-a9bc-4e1a-a7fe-2fe87d958daf None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:24.924490 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71e93b-a9bc-4e1a-a7fe-2fe87d958daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:24.943396 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-1e71e93b-a9bc-4e1a-a7fe-2fe87d958daf None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:24.944585 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-1e71e93b-a9bc-4e1a-a7fe-2fe87d958daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:24.952498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 534/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:04:24 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:25.294246 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b26d37-ff7d-4045-91d6-b416cfe08d13 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:25.305288 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b26d37-ff7d-4045-91d6-b416cfe08d13 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:25.308782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70f071-b01f-4f73-ac15-2611691383d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:25.309382 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70f071-b01f-4f73-ac15-2611691383d3 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:25.309657 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70f071-b01f-4f73-ac15-2611691383d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:25.309925 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70f071-b01f-4f73-ac15-2611691383d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:25.319045 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70f071-b01f-4f73-ac15-2611691383d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:25.320480 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70f071-b01f-4f73-ac15-2611691383d3 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:25.330762 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 529/1063] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:25 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:27.916628 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45aed58-8b71-4725-aa06-bc2369ca7029 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:27.917154 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45aed58-8b71-4725-aa06-bc2369ca7029 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:27.917154 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45aed58-8b71-4725-aa06-bc2369ca7029 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:27.918437 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 535/1064] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:04:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:27.924088 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d589033-3793-4dc3-bd9e-8f01373eb626 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:27.924511 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d589033-3793-4dc3-bd9e-8f01373eb626 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:27.924638 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d589033-3793-4dc3-bd9e-8f01373eb626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:27.943805 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-7d589033-3793-4dc3-bd9e-8f01373eb626 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:27.944997 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-7d589033-3793-4dc3-bd9e-8f01373eb626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:27.952978 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 530/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:04:27 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:28.301023 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45aed58-8b71-4725-aa06-bc2369ca7029 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:28.313211 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45aed58-8b71-4725-aa06-bc2369ca7029 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:28.317438 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e58412-6082-427e-87fb-a67a47a005d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:28.318041 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e58412-6082-427e-87fb-a67a47a005d8 service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:28.318368 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e58412-6082-427e-87fb-a67a47a005d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:28.318636 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e58412-6082-427e-87fb-a67a47a005d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:28.328228 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e58412-6082-427e-87fb-a67a47a005d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:28.329647 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e58412-6082-427e-87fb-a67a47a005d8 service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:28.338973 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 536/1066] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:28 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:30.688028 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a7061-2025-47aa-bdf6-62928c4e1b75 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:30.688568 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a7061-2025-47aa-bdf6-62928c4e1b75 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:30.688568 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a7061-2025-47aa-bdf6-62928c4e1b75 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:30.689913 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 531/1067] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:04:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:30.695262 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603e170-abee-457b-8851-a0e2b5179cbc None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:30.695699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603e170-abee-457b-8851-a0e2b5179cbc None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:30.695834 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603e170-abee-457b-8851-a0e2b5179cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:30.716057 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-8603e170-abee-457b-8851-a0e2b5179cbc None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:30.717276 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-8603e170-abee-457b-8851-a0e2b5179cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:30.726015 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 537/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:04:30 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:31.061054 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a7061-2025-47aa-bdf6-62928c4e1b75 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:31.072176 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a7061-2025-47aa-bdf6-62928c4e1b75 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:31.075894 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10966f4-5124-4431-933f-6a661189925c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:31.076474 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10966f4-5124-4431-933f-6a661189925c service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:31.076748 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10966f4-5124-4431-933f-6a661189925c service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:31.077011 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10966f4-5124-4431-933f-6a661189925c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:31.086441 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10966f4-5124-4431-933f-6a661189925c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:31.087967 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10966f4-5124-4431-933f-6a661189925c service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:31.097201 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 532/1069] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:31 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:33.445818 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120b324-fccd-4de9-9a1a-b285eb53c8e3 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:33.446354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120b324-fccd-4de9-9a1a-b285eb53c8e3 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:33.446354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120b324-fccd-4de9-9a1a-b285eb53c8e3 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:33.447758 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 538/1070] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:04:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:33.454141 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a9059-6066-4307-82b5-f79855ca4ea6 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:33.454601 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a9059-6066-4307-82b5-f79855ca4ea6 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:33.454700 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a9059-6066-4307-82b5-f79855ca4ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:33.473693 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-d11a9059-6066-4307-82b5-f79855ca4ea6 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:33.474943 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-d11a9059-6066-4307-82b5-f79855ca4ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:33.482791 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 533/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:04:33 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:33.841971 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120b324-fccd-4de9-9a1a-b285eb53c8e3 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:33.853390 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120b324-fccd-4de9-9a1a-b285eb53c8e3 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:33.856942 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec254b-d2de-4762-a096-502e05f8446d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:33.857609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec254b-d2de-4762-a096-502e05f8446d service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:33.857890 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec254b-d2de-4762-a096-502e05f8446d service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:33.858164 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec254b-d2de-4762-a096-502e05f8446d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:33.869787 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec254b-d2de-4762-a096-502e05f8446d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:33.871326 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec254b-d2de-4762-a096-502e05f8446d service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:33.881083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 539/1072] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:33 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:36.135492 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c043293-0cc1-4f53-8028-3dcffd1baf87 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:36.136062 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c043293-0cc1-4f53-8028-3dcffd1baf87 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:36.136062 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c043293-0cc1-4f53-8028-3dcffd1baf87 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:36.137301 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 534/1073] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:04:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 01:04:36.143278 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643101cb-9fe1-41b0-9b60-ba9ffb890ee0 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:36.143729 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643101cb-9fe1-41b0-9b60-ba9ffb890ee0 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:36.143877 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643101cb-9fe1-41b0-9b60-ba9ffb890ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:36.162372 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-643101cb-9fe1-41b0-9b60-ba9ffb890ee0 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:36.163583 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-643101cb-9fe1-41b0-9b60-ba9ffb890ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:36.171327 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 540/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:04:36 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:36.519608 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c043293-0cc1-4f53-8028-3dcffd1baf87 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:36.530793 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c043293-0cc1-4f53-8028-3dcffd1baf87 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:36.535361 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7924be-afa7-4e65-b0c6-6608dea19a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:36.535962 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7924be-afa7-4e65-b0c6-6608dea19a07 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:36.536239 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7924be-afa7-4e65-b0c6-6608dea19a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:36.536506 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7924be-afa7-4e65-b0c6-6608dea19a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:36.546303 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7924be-afa7-4e65-b0c6-6608dea19a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:36.548234 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7924be-afa7-4e65-b0c6-6608dea19a07 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:36.558120 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 535/1075] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:36 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:38.879382 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e3785-c20a-4a69-aa1b-78c7746e6bd8 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:38.879977 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e3785-c20a-4a69-aa1b-78c7746e6bd8 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:38.879977 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e3785-c20a-4a69-aa1b-78c7746e6bd8 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:38.881390 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 541/1076] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:04:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:38.886697 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14455073-fec7-4fe9-857a-2029bb569f54 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:38.887177 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14455073-fec7-4fe9-857a-2029bb569f54 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:38.887291 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14455073-fec7-4fe9-857a-2029bb569f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:38.895173 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=70 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:38.907318 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-14455073-fec7-4fe9-857a-2029bb569f54 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:38.908574 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-14455073-fec7-4fe9-857a-2029bb569f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:38.917484 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 536/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:04:38 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:39.266297 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e3785-c20a-4a69-aa1b-78c7746e6bd8 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:39.271778 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=77 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:39.277412 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e3785-c20a-4a69-aa1b-78c7746e6bd8 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:39.283501 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5ee16-3326-48f2-af1c-da0a94ab55d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:39.283501 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5ee16-3326-48f2-af1c-da0a94ab55d8 service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:39.283501 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5ee16-3326-48f2-af1c-da0a94ab55d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:39.283501 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5ee16-3326-48f2-af1c-da0a94ab55d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:39.291571 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5ee16-3326-48f2-af1c-da0a94ab55d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:39.293008 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5ee16-3326-48f2-af1c-da0a94ab55d8 service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:39.302773 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 542/1078] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:39 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:41.548425 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a814bb-4809-415c-9e7b-b37186813abc None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:41.548980 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a814bb-4809-415c-9e7b-b37186813abc None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:41.548980 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a814bb-4809-415c-9e7b-b37186813abc None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:41.550310 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 537/1079] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:04:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:41.555952 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb353c-dac0-47ba-b9c1-acfb9c25b6a4 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:41.556415 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb353c-dac0-47ba-b9c1-acfb9c25b6a4 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:41.556527 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb353c-dac0-47ba-b9c1-acfb9c25b6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:41.580270 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-14cb353c-dac0-47ba-b9c1-acfb9c25b6a4 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:41.581499 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-14cb353c-dac0-47ba-b9c1-acfb9c25b6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:41.589604 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 543/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:04:41 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:41.936734 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a814bb-4809-415c-9e7b-b37186813abc None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:41.947939 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a814bb-4809-415c-9e7b-b37186813abc None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:41.952099 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d150c-f4dc-41a4-bbb0-3dcca5c32740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:41.952702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d150c-f4dc-41a4-bbb0-3dcca5c32740 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:41.952995 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d150c-f4dc-41a4-bbb0-3dcca5c32740 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:41.953317 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d150c-f4dc-41a4-bbb0-3dcca5c32740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:41.963008 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d150c-f4dc-41a4-bbb0-3dcca5c32740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:41.964446 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d150c-f4dc-41a4-bbb0-3dcca5c32740 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:41.975478 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 538/1081] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:41 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:44.286210 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb79c1-de47-4e67-ad8d-b3db9ab29a34 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:44.286764 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb79c1-de47-4e67-ad8d-b3db9ab29a34 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:44.286764 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb79c1-de47-4e67-ad8d-b3db9ab29a34 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:44.288112 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 544/1082] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:04:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:44.293502 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424c919-6133-4cb4-9a2b-33e68db957a8 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:44.302289 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424c919-6133-4cb4-9a2b-33e68db957a8 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:44.302289 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424c919-6133-4cb4-9a2b-33e68db957a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:44.314679 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-1424c919-6133-4cb4-9a2b-33e68db957a8 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:44.315928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-1424c919-6133-4cb4-9a2b-33e68db957a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:44.324174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 539/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:04:44 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:44.676350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb79c1-de47-4e67-ad8d-b3db9ab29a34 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:44.687307 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb79c1-de47-4e67-ad8d-b3db9ab29a34 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:44.690923 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38f7ef-c9b9-4dbb-8f13-040d07bdca50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:44.691513 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38f7ef-c9b9-4dbb-8f13-040d07bdca50 service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:44.691787 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38f7ef-c9b9-4dbb-8f13-040d07bdca50 service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:44.692054 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38f7ef-c9b9-4dbb-8f13-040d07bdca50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:44.706152 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38f7ef-c9b9-4dbb-8f13-040d07bdca50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:44.707639 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38f7ef-c9b9-4dbb-8f13-040d07bdca50 service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:44.718444 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 545/1084] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:44 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:47.012121 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8181a-19e5-4ecc-9f67-534f761c3144 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:47.012637 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8181a-19e5-4ecc-9f67-534f761c3144 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:47.012637 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8181a-19e5-4ecc-9f67-534f761c3144 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:47.013976 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 540/1085] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:04:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:04:47.019751 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad455bb1-74bd-403e-be1c-b84eca65eac0 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:47.020171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad455bb1-74bd-403e-be1c-b84eca65eac0 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:47.020309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad455bb1-74bd-403e-be1c-b84eca65eac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:47.040107 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-ad455bb1-74bd-403e-be1c-b84eca65eac0 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:04:47.041354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-ad455bb1-74bd-403e-be1c-b84eca65eac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:04:47.049042 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 546/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:04:47 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:04:47.396488 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8181a-19e5-4ecc-9f67-534f761c3144 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:04:47.407207 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8181a-19e5-4ecc-9f67-534f761c3144 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:04:47.410558 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70220b7d-adc4-4512-8a28-0e306364982f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:04:47.411181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70220b7d-adc4-4512-8a28-0e306364982f service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:04:47.411453 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70220b7d-adc4-4512-8a28-0e306364982f service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:04:47.411720 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70220b7d-adc4-4512-8a28-0e306364982f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:04:47.420620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70220b7d-adc4-4512-8a28-0e306364982f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:04:47.422052 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70220b7d-adc4-4512-8a28-0e306364982f service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:04:47.431557 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 541/1087] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:04:47 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:04:57.035319 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=17 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:04:57.427374 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=17 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:12.167256 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3b893-9636-47d0-b562-3c84b82f37a3 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:12.167817 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3b893-9636-47d0-b562-3c84b82f37a3 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:12.167817 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3b893-9636-47d0-b562-3c84b82f37a3 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:12.169074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 547/1088] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:05:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:05:12.179899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067fe03-f2ad-4cf4-a6fd-b5cee80b66f5 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:12.180401 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067fe03-f2ad-4cf4-a6fd-b5cee80b66f5 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:12.180507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067fe03-f2ad-4cf4-a6fd-b5cee80b66f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:12.200180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-f067fe03-f2ad-4cf4-a6fd-b5cee80b66f5 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:12.201409 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-f067fe03-f2ad-4cf4-a6fd-b5cee80b66f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:12.210008 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 542/1089] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:05:12 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:12.584011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c15296-e865-4646-b208-3def69943787 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:12.584296 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c15296-e865-4646-b208-3def69943787 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:12.584575 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c15296-e865-4646-b208-3def69943787 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:12.585893 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 548/1090] 10.222.0.121 () {54 vars in 972 bytes} [Fri Aug 26 01:05:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:05:12.591407 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7af886-d795-4a9e-a13b-4a190522ee04 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:12.591698 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7af886-d795-4a9e-a13b-4a190522ee04 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:12.591977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7af886-d795-4a9e-a13b-4a190522ee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:12.610979 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-4b7af886-d795-4a9e-a13b-4a190522ee04 None None] MFA Rules not processed for user `4fe450e040874be58ea27dd47c3ff7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:12.612186 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-4b7af886-d795-4a9e-a13b-4a190522ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:12.618969 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 543/1091] 10.222.0.121 () {58 vars in 1069 bytes} [Fri Aug 26 01:05:12 2022] POST /identity/v3/auth/tokens => generated 2688 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:12.626874 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c15296-e865-4646-b208-3def69943787 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:12.637527 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c15296-e865-4646-b208-3def69943787 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:12.641084 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae21c97-62e1-4136-abe5-9facf83da8a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe450e040874be58ea27dd47c3ff7a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:12.642228 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae21c97-62e1-4136-abe5-9facf83da8a6 service glance] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:12.642505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae21c97-62e1-4136-abe5-9facf83da8a6 service glance] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:12.642773 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae21c97-62e1-4136-abe5-9facf83da8a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:12.651725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae21c97-62e1-4136-abe5-9facf83da8a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:12.653160 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae21c97-62e1-4136-abe5-9facf83da8a6 service glance] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:12.664253 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 549/1092] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:12 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:05:15.390408 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3898f94-ac93-4706-9c1c-9cf3db5bb9cb None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:15.391011 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3898f94-ac93-4706-9c1c-9cf3db5bb9cb None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:15.391011 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3898f94-ac93-4706-9c1c-9cf3db5bb9cb None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:15.392363 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 544/1093] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:05:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:05:15.397689 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891bb16-331a-4aab-bfda-357709a3637f None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:15.398135 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891bb16-331a-4aab-bfda-357709a3637f None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:15.398272 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891bb16-331a-4aab-bfda-357709a3637f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:15.417888 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-a891bb16-331a-4aab-bfda-357709a3637f None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:15.419122 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-a891bb16-331a-4aab-bfda-357709a3637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:15.427752 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 550/1094] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:05:15 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:05:15.758057 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3898f94-ac93-4706-9c1c-9cf3db5bb9cb None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:15.771266 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3898f94-ac93-4706-9c1c-9cf3db5bb9cb None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:15.775606 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76580f4a-c078-4944-a912-4601cac333c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:15.776208 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76580f4a-c078-4944-a912-4601cac333c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:15.776487 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76580f4a-c078-4944-a912-4601cac333c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:15.776759 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76580f4a-c078-4944-a912-4601cac333c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:15.777459 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76580f4a-c078-4944-a912-4601cac333c6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:15.779295 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: WARNING py.warnings [None req-76580f4a-c078-4944-a912-4601cac333c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:05:15.779295 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: warnings.warn(msg) Aug 26 01:05:15.779295 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: Aug 26 01:05:15.780449 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76580f4a-c078-4944-a912-4601cac333c6 admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:15.799041 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 545/1095] 10.222.0.121 () {56 vars in 1113 bytes} [Fri Aug 26 01:05:15 2022] GET /identity/v3/projects => generated 1612 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 01:05:18.009512 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092586cc-4ed6-401d-8902-93581d0d7f75 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:18.010060 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092586cc-4ed6-401d-8902-93581d0d7f75 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:18.010060 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092586cc-4ed6-401d-8902-93581d0d7f75 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:18.011362 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 551/1096] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:05:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:05:18.017974 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af5309-7455-43a1-9ecf-4915931bd327 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:18.018422 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af5309-7455-43a1-9ecf-4915931bd327 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:18.018551 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af5309-7455-43a1-9ecf-4915931bd327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:18.038171 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-01af5309-7455-43a1-9ecf-4915931bd327 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:18.039376 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-01af5309-7455-43a1-9ecf-4915931bd327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:18.047037 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 546/1097] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:05:18 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:18.401701 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092586cc-4ed6-401d-8902-93581d0d7f75 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:18.415799 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092586cc-4ed6-401d-8902-93581d0d7f75 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:18.420857 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aa1fa-4f89-4b15-a2c5-b0b24207d5e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:18.421455 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aa1fa-4f89-4b15-a2c5-b0b24207d5e9 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:18.421728 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aa1fa-4f89-4b15-a2c5-b0b24207d5e9 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:18.421998 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aa1fa-4f89-4b15-a2c5-b0b24207d5e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:18.431268 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473aa1fa-4f89-4b15-a2c5-b0b24207d5e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:18.432888 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473aa1fa-4f89-4b15-a2c5-b0b24207d5e9 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:18.442909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 552/1098] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:18 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:05:20.857351 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8720156-061f-4aa6-b0f6-3dd5918bd958 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:20.857876 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8720156-061f-4aa6-b0f6-3dd5918bd958 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:20.857876 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8720156-061f-4aa6-b0f6-3dd5918bd958 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:20.859205 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 547/1099] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:05:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:05:20.865023 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06f6f5-ab64-41ab-8853-e405d81b7210 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:20.865460 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06f6f5-ab64-41ab-8853-e405d81b7210 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:20.865570 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06f6f5-ab64-41ab-8853-e405d81b7210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:20.884815 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-bf06f6f5-ab64-41ab-8853-e405d81b7210 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:20.886022 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-bf06f6f5-ab64-41ab-8853-e405d81b7210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:20.893710 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 553/1100] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:05:20 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:21.235851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8720156-061f-4aa6-b0f6-3dd5918bd958 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:21.246833 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8720156-061f-4aa6-b0f6-3dd5918bd958 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:21.250417 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dc559-d2aa-423e-815b-836f9529f988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:21.252540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dc559-d2aa-423e-815b-836f9529f988 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:21.252540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dc559-d2aa-423e-815b-836f9529f988 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:21.252540 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dc559-d2aa-423e-815b-836f9529f988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:21.261026 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639dc559-d2aa-423e-815b-836f9529f988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:21.262833 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639dc559-d2aa-423e-815b-836f9529f988 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:21.272598 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 548/1101] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:21 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:05:23.528153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3d428-43b1-4f8b-9872-7122b61efe64 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:23.528727 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3d428-43b1-4f8b-9872-7122b61efe64 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:23.528727 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3d428-43b1-4f8b-9872-7122b61efe64 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:23.530049 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 554/1102] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:05:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:05:23.535862 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad410d-60c2-46f9-86cd-523e8faa2980 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:23.536312 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad410d-60c2-46f9-86cd-523e8faa2980 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:23.536408 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad410d-60c2-46f9-86cd-523e8faa2980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:23.556205 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-53ad410d-60c2-46f9-86cd-523e8faa2980 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:23.557496 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-53ad410d-60c2-46f9-86cd-523e8faa2980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:23.565522 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 549/1103] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:05:23 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:23.918527 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3d428-43b1-4f8b-9872-7122b61efe64 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:23.930241 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3d428-43b1-4f8b-9872-7122b61efe64 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:23.934031 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6658609-3ca0-4af8-aefe-deb46f513969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:23.934756 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6658609-3ca0-4af8-aefe-deb46f513969 service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:23.935093 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6658609-3ca0-4af8-aefe-deb46f513969 service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:23.935438 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6658609-3ca0-4af8-aefe-deb46f513969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:23.945345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6658609-3ca0-4af8-aefe-deb46f513969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:23.946769 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6658609-3ca0-4af8-aefe-deb46f513969 service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:23.956938 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 555/1104] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:23 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:05:26.321982 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7cc3c-913d-420c-be7b-74e45c4cc0e4 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:26.322497 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7cc3c-913d-420c-be7b-74e45c4cc0e4 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:26.322595 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7cc3c-913d-420c-be7b-74e45c4cc0e4 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:26.323911 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 550/1105] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:05:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:05:26.329899 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7f362-7160-49e4-be6b-47eaec824a5b None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:26.330321 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7f362-7160-49e4-be6b-47eaec824a5b None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:26.330434 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7f362-7160-49e4-be6b-47eaec824a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:26.350398 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-a1e7f362-7160-49e4-be6b-47eaec824a5b None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:26.351683 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-a1e7f362-7160-49e4-be6b-47eaec824a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:26.359499 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 556/1106] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:05:26 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:26.719382 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7cc3c-913d-420c-be7b-74e45c4cc0e4 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:26.730326 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7cc3c-913d-420c-be7b-74e45c4cc0e4 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:26.733894 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7d4c7-6d96-4435-bdd7-6c39b5fad870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:26.734489 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7d4c7-6d96-4435-bdd7-6c39b5fad870 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:26.734766 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7d4c7-6d96-4435-bdd7-6c39b5fad870 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:26.735089 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7d4c7-6d96-4435-bdd7-6c39b5fad870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:26.744464 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7d4c7-6d96-4435-bdd7-6c39b5fad870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:26.745906 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7d4c7-6d96-4435-bdd7-6c39b5fad870 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:26.755986 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 551/1107] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:26 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:05:29.412011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c82088-ffd8-473e-9cb8-24c255f3796c None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:29.412574 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c82088-ffd8-473e-9cb8-24c255f3796c None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:29.412574 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c82088-ffd8-473e-9cb8-24c255f3796c None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:29.413891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 557/1108] 10.222.0.121 () {54 vars in 932 bytes} [Fri Aug 26 01:05:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:05:29.419232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b29887-3f86-40af-9d18-10a5213bd088 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:29.419658 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b29887-3f86-40af-9d18-10a5213bd088 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:29.419768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b29887-3f86-40af-9d18-10a5213bd088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:29.440462 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-36b29887-3f86-40af-9d18-10a5213bd088 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:05:29.441649 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-36b29887-3f86-40af-9d18-10a5213bd088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:05:29.449328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 552/1109] 10.222.0.121 () {58 vars in 1029 bytes} [Fri Aug 26 01:05:29 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:05:29.800483 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c82088-ffd8-473e-9cb8-24c255f3796c None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:05:29.811249 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c82088-ffd8-473e-9cb8-24c255f3796c None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:05:29.815323 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e7b6e-f93b-4604-83bd-a2eb71c325ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:05:29.815904 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e7b6e-f93b-4604-83bd-a2eb71c325ef service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:05:29.816177 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e7b6e-f93b-4604-83bd-a2eb71c325ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:05:29.816443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e7b6e-f93b-4604-83bd-a2eb71c325ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:05:29.825855 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e7b6e-f93b-4604-83bd-a2eb71c325ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:05:29.827310 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e7b6e-f93b-4604-83bd-a2eb71c325ef service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:05:29.839195 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 558/1110] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:05:29 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:05:39.435209 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=33 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:05:39.833459 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=33 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:05.212552 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c799b0-7247-4b7d-8483-364bb9df96e4 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:05.213174 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c799b0-7247-4b7d-8483-364bb9df96e4 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:05.213295 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c799b0-7247-4b7d-8483-364bb9df96e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:05.233957 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-a7c799b0-7247-4b7d-8483-364bb9df96e4 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:07:05.235187 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-a7c799b0-7247-4b7d-8483-364bb9df96e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:07:05.243118 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 553/1111] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:07:05 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:07:05.251904 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0bf93-f6b9-45c1-a253-b64b6c1a1ce9 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:05.252431 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0bf93-f6b9-45c1-a253-b64b6c1a1ce9 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:05.252431 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0bf93-f6b9-45c1-a253-b64b6c1a1ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:05.271301 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-f2b0bf93-f6b9-45c1-a253-b64b6c1a1ce9 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:07:05.272505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-f2b0bf93-f6b9-45c1-a253-b64b6c1a1ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:07:05.280414 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 559/1112] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:07:05 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:07:05.284931 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c799b0-7247-4b7d-8483-364bb9df96e4 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:07:05.295220 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c799b0-7247-4b7d-8483-364bb9df96e4 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:07:05.299777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560207c0-d369-468d-a4b9-9c64a3c74a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:07:05.300381 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560207c0-d369-468d-a4b9-9c64a3c74a34 admin admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:05.300659 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560207c0-d369-468d-a4b9-9c64a3c74a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:05.300931 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560207c0-d369-468d-a4b9-9c64a3c74a34 admin admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:05.301618 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560207c0-d369-468d-a4b9-9c64a3c74a34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 01:07:05.301905 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560207c0-d369-468d-a4b9-9c64a3c74a34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:07:05.302962 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: WARNING py.warnings [None req-560207c0-d369-468d-a4b9-9c64a3c74a34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:07:05.302962 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: warnings.warn(msg) Aug 26 01:07:05.302962 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: Aug 26 01:07:05.303861 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560207c0-d369-468d-a4b9-9c64a3c74a34 admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:07:05.316295 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 554/1113] 10.222.0.121 () {58 vars in 1158 bytes} [Fri Aug 26 01:07:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 01:07:05.324613 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0bf93-f6b9-45c1-a253-b64b6c1a1ce9 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:07:05.333984 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0bf93-f6b9-45c1-a253-b64b6c1a1ce9 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:07:05.339127 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fc10f-dc35-47d6-b669-9d591d25643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:07:05.339716 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fc10f-dc35-47d6-b669-9d591d25643e admin admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:05.339991 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fc10f-dc35-47d6-b669-9d591d25643e admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:05.340258 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fc10f-dc35-47d6-b669-9d591d25643e admin admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:05.340881 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fc10f-dc35-47d6-b669-9d591d25643e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:07:05.342688 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: WARNING py.warnings [None req-483fc10f-dc35-47d6-b669-9d591d25643e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:07:05.342688 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: warnings.warn(msg) Aug 26 01:07:05.342688 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: Aug 26 01:07:05.343909 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fc10f-dc35-47d6-b669-9d591d25643e admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:07:05.455850 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 560/1114] 10.222.0.121 () {60 vars in 1158 bytes} [Fri Aug 26 01:07:05 2022] POST /identity/v3/projects => generated 380 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 01:07:05.460133 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560207c0-d369-468d-a4b9-9c64a3c74a34 admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:07:05.470691 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560207c0-d369-468d-a4b9-9c64a3c74a34 admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:07:05.526043 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ec0c2-9b17-4f36-b6cb-2544696b6968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:07:05.526567 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ec0c2-9b17-4f36-b6cb-2544696b6968 admin admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:05.526873 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ec0c2-9b17-4f36-b6cb-2544696b6968 admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:05.527144 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ec0c2-9b17-4f36-b6cb-2544696b6968 admin admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:05.527757 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ec0c2-9b17-4f36-b6cb-2544696b6968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:07:05.528777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: WARNING py.warnings [None req-d82ec0c2-9b17-4f36-b6cb-2544696b6968 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:07:05.528777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: warnings.warn(msg) Aug 26 01:07:05.528777 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: Aug 26 01:07:05.529981 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ec0c2-9b17-4f36-b6cb-2544696b6968 admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:07:05.632582 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 555/1115] 10.222.0.121 () {60 vars in 1149 bytes} [Fri Aug 26 01:07:05 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 01:07:05.636753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fc10f-dc35-47d6-b669-9d591d25643e admin admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:07:05.647091 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fc10f-dc35-47d6-b669-9d591d25643e admin admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:07:05.652070 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a68280-4f54-47db-9ff4-163b5acbfa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:07:05.652654 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a68280-4f54-47db-9ff4-163b5acbfa1b admin admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:05.652929 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a68280-4f54-47db-9ff4-163b5acbfa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:05.653196 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a68280-4f54-47db-9ff4-163b5acbfa1b admin admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:05.653816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a68280-4f54-47db-9ff4-163b5acbfa1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:07:05.654811 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: WARNING py.warnings [None req-d3a68280-4f54-47db-9ff4-163b5acbfa1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:07:05.654811 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: warnings.warn(msg) Aug 26 01:07:05.654811 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: Aug 26 01:07:05.655733 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a68280-4f54-47db-9ff4-163b5acbfa1b admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:07:05.669829 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 561/1116] 10.222.0.121 () {58 vars in 1127 bytes} [Fri Aug 26 01:07:05 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 01:07:05.673764 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ec0c2-9b17-4f36-b6cb-2544696b6968 admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:07:05.684914 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ec0c2-9b17-4f36-b6cb-2544696b6968 admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:07:05.689747 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0030b39-6df9-4b36-8cac-8a9e8483bd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:07:05.690338 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0030b39-6df9-4b36-8cac-8a9e8483bd6c admin admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:05.690612 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0030b39-6df9-4b36-8cac-8a9e8483bd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:05.690919 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0030b39-6df9-4b36-8cac-8a9e8483bd6c admin admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:05.691551 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0030b39-6df9-4b36-8cac-8a9e8483bd6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:07:05.692558 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: WARNING py.warnings [None req-d0030b39-6df9-4b36-8cac-8a9e8483bd6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:07:05.692558 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: warnings.warn(msg) Aug 26 01:07:05.692558 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: Aug 26 01:07:05.693433 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0030b39-6df9-4b36-8cac-8a9e8483bd6c admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:07:05.707503 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 556/1117] 10.222.0.121 () {58 vars in 1127 bytes} [Fri Aug 26 01:07:05 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 01:07:05.711597 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a68280-4f54-47db-9ff4-163b5acbfa1b admin admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:07:05.722113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a68280-4f54-47db-9ff4-163b5acbfa1b admin admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:07:05.726643 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60384cb-9bd1-41fa-a369-3d3ee16c746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:07:05.727326 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60384cb-9bd1-41fa-a369-3d3ee16c746f admin admin] REQUEST_METHOD: `PUT` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:05.727684 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60384cb-9bd1-41fa-a369-3d3ee16c746f admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:05.727961 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60384cb-9bd1-41fa-a369-3d3ee16c746f admin admin] PATH_INFO: `/v3/projects/c372e77df9b34b57b5b618838f9e4a7f/users/b76ad9d95c5048eb96777189f9bb814d/roles/8acc6a2016c149a0b80cf3c56b5ae91a` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:05.743183 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60384cb-9bd1-41fa-a369-3d3ee16c746f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c372e77df9b34b57b5b618838f9e4a7f, user_id=b76ad9d95c5048eb96777189f9bb814d, role_id=8acc6a2016c149a0b80cf3c56b5ae91a)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:07:05.744306 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: WARNING py.warnings [None req-f60384cb-9bd1-41fa-a369-3d3ee16c746f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:07:05.744306 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: warnings.warn(msg) Aug 26 01:07:05.744306 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: Aug 26 01:07:05.746311 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60384cb-9bd1-41fa-a369-3d3ee16c746f admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:07:05.878178 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 562/1118] 10.222.0.121 () {60 vars in 1488 bytes} [Fri Aug 26 01:07:05 2022] PUT /identity/v3/projects/c372e77df9b34b57b5b618838f9e4a7f/users/b76ad9d95c5048eb96777189f9bb814d/roles/8acc6a2016c149a0b80cf3c56b5ae91a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:07:05.891139 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3948c9-f40d-42a6-a7a5-e63405326d81 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:05.891432 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3948c9-f40d-42a6-a7a5-e63405326d81 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:05.891713 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3948c9-f40d-42a6-a7a5-e63405326d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:05.920017 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-7d3948c9-f40d-42a6-a7a5-e63405326d81 None None] MFA Rules not processed for user `b76ad9d95c5048eb96777189f9bb814d`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:07:05.921235 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-7d3948c9-f40d-42a6-a7a5-e63405326d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:07:05.984527 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 557/1119] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:07:05 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:07:05.997566 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadef76-6e01-40ef-9397-e5f4467de738 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:05.997858 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadef76-6e01-40ef-9397-e5f4467de738 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:05.998139 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadef76-6e01-40ef-9397-e5f4467de738 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:05.999488 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 563/1120] 10.222.0.121 () {54 vars in 969 bytes} [Fri Aug 26 01:07:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:07:06.004381 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01148c75-69e9-47ba-9ffc-220949323a56 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:06.004670 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01148c75-69e9-47ba-9ffc-220949323a56 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:06.004965 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01148c75-69e9-47ba-9ffc-220949323a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:06.024298 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-01148c75-69e9-47ba-9ffc-220949323a56 None None] MFA Rules not processed for user `b48c6b8ef7284907bbfd5b48e2b58516`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:07:06.026064 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-01148c75-69e9-47ba-9ffc-220949323a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:07:06.069631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:06.077491 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 558/1121] 10.222.0.121 () {58 vars in 1066 bytes} [Fri Aug 26 01:07:06 2022] POST /identity/v3/auth/tokens => generated 2688 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:07:06.085480 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadef76-6e01-40ef-9397-e5f4467de738 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:07:06.096259 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadef76-6e01-40ef-9397-e5f4467de738 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:07:06.099754 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c842d-dcfe-4672-9d73-4ba6c870ed99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48c6b8ef7284907bbfd5b48e2b58516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:07:06.100340 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c842d-dcfe-4672-9d73-4ba6c870ed99 service cinder] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:06.100619 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c842d-dcfe-4672-9d73-4ba6c870ed99 service cinder] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:06.100889 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c842d-dcfe-4672-9d73-4ba6c870ed99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:06.109118 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c842d-dcfe-4672-9d73-4ba6c870ed99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:07:06.110547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c842d-dcfe-4672-9d73-4ba6c870ed99 service cinder] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:07:06.119765 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 564/1122] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:07:06 2022] GET /identity/v3/auth/tokens => generated 2824 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:07:06.160130 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59a76b-3ea5-405f-b1b7-440612c04912 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:06.160423 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59a76b-3ea5-405f-b1b7-440612c04912 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:06.160703 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59a76b-3ea5-405f-b1b7-440612c04912 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:06.162010 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 559/1123] 10.222.0.121 () {52 vars in 835 bytes} [Fri Aug 26 01:07:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:07:06.165443 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c842d-dcfe-4672-9d73-4ba6c870ed99 service cinder] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:07:06.231540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c842d-dcfe-4672-9d73-4ba6c870ed99 service cinder] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:07:06.236164 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c6239-0f74-47f2-ac25-b872cce2c00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:07:06.236786 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c6239-0f74-47f2-ac25-b872cce2c00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:06.237069 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c6239-0f74-47f2-ac25-b872cce2c00a admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:06.237345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c6239-0f74-47f2-ac25-b872cce2c00a admin admin] PATH_INFO: `/v3/users/b76ad9d95c5048eb96777189f9bb814d` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:06.238588 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c6239-0f74-47f2-ac25-b872cce2c00a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b76ad9d95c5048eb96777189f9bb814d)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:07:06.239658 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: WARNING py.warnings [None req-768c6239-0f74-47f2-ac25-b872cce2c00a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:07:06.239658 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: warnings.warn(msg) Aug 26 01:07:06.239658 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: Aug 26 01:07:06.240920 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c6239-0f74-47f2-ac25-b872cce2c00a admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:07:06.550013 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-768c6239-0f74-47f2-ac25-b872cce2c00a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b76ad9d95c5048eb96777189f9bb814d'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:07:06.575343 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-768c6239-0f74-47f2-ac25-b872cce2c00a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b76ad9d95c5048eb96777189f9bb814d'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:07:06.578451 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-768c6239-0f74-47f2-ac25-b872cce2c00a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b76ad9d95c5048eb96777189f9bb814d'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:07:06.578451 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-768c6239-0f74-47f2-ac25-b872cce2c00a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b76ad9d95c5048eb96777189f9bb814d'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:07:06.694841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-768c6239-0f74-47f2-ac25-b872cce2c00a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b76ad9d95c5048eb96777189f9bb814d'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:07:06.705949 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:06.716003 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 565/1124] 10.222.0.121 () {58 vars in 1229 bytes} [Fri Aug 26 01:07:06 2022] DELETE /identity/v3/users/b76ad9d95c5048eb96777189f9bb814d => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:07:06.720536 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9c75a-c0bb-4876-b9fd-9f6de2ca1d08 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:06.721014 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9c75a-c0bb-4876-b9fd-9f6de2ca1d08 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:06.721110 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9c75a-c0bb-4876-b9fd-9f6de2ca1d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:06.740118 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-31f9c75a-c0bb-4876-b9fd-9f6de2ca1d08 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:07:06.741324 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-31f9c75a-c0bb-4876-b9fd-9f6de2ca1d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:07:06.802500 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 560/1125] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:07:06 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:07:06.810532 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c6239-0f74-47f2-ac25-b872cce2c00a admin admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:07:06.812021 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-768c6239-0f74-47f2-ac25-b872cce2c00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:07:06.868838 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c6239-0f74-47f2-ac25-b872cce2c00a admin admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:07:06.872515 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6dbae-d08e-4a87-bb0c-1c12b1370cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:07:06.873119 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6dbae-d08e-4a87-bb0c-1c12b1370cdc service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:06.873399 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6dbae-d08e-4a87-bb0c-1c12b1370cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:06.873675 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6dbae-d08e-4a87-bb0c-1c12b1370cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:06.882505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6dbae-d08e-4a87-bb0c-1c12b1370cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:07:06.884008 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6dbae-d08e-4a87-bb0c-1c12b1370cdc service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:07:06.893383 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 566/1126] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:07:06 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:07:07.428065 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9c75a-c0bb-4876-b9fd-9f6de2ca1d08 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:07:07.429477 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-31f9c75a-c0bb-4876-b9fd-9f6de2ca1d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:07:07.441985 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9c75a-c0bb-4876-b9fd-9f6de2ca1d08 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:07:07.447738 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed27282-773e-4e9e-a19b-92b13a999077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:07:07.448364 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed27282-773e-4e9e-a19b-92b13a999077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:07:07.448638 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed27282-773e-4e9e-a19b-92b13a999077 admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:07:07.448919 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed27282-773e-4e9e-a19b-92b13a999077 admin admin] PATH_INFO: `/v3/projects/c372e77df9b34b57b5b618838f9e4a7f` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:07:07.450030 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed27282-773e-4e9e-a19b-92b13a999077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c372e77df9b34b57b5b618838f9e4a7f)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:07:07.451089 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: WARNING py.warnings [None req-4ed27282-773e-4e9e-a19b-92b13a999077 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:07:07.451089 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: warnings.warn(msg) Aug 26 01:07:07.451089 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: Aug 26 01:07:07.452604 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed27282-773e-4e9e-a19b-92b13a999077 admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:07:07.597065 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-4ed27282-773e-4e9e-a19b-92b13a999077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c372e77df9b34b57b5b618838f9e4a7f', 'request_id': 'req-4ed27282-773e-4e9e-a19b-92b13a999077'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:07:07.671875 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-4ed27282-773e-4e9e-a19b-92b13a999077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c372e77df9b34b57b5b618838f9e4a7f', 'request_id': 'req-4ed27282-773e-4e9e-a19b-92b13a999077'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:07:07.678244 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-4ed27282-773e-4e9e-a19b-92b13a999077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c372e77df9b34b57b5b618838f9e4a7f', 'request_id': 'req-4ed27282-773e-4e9e-a19b-92b13a999077'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:07:07.699593 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-4ed27282-773e-4e9e-a19b-92b13a999077 admin admin] The token cache is being invalidate because project c372e77df9b34b57b5b618838f9e4a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 01:07:07.699883 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-4ed27282-773e-4e9e-a19b-92b13a999077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:07:07.700526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-4ed27282-773e-4e9e-a19b-92b13a999077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:07:07.702093 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 561/1127] 10.222.0.121 () {58 vars in 1238 bytes} [Fri Aug 26 01:07:07 2022] DELETE /identity/v3/projects/c372e77df9b34b57b5b618838f9e4a7f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:07:17.392065 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=29 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:07:17.695670 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:08:37.123586 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d2565-b3e9-4fa3-85cd-660f7c8b3aef None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:37.124204 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d2565-b3e9-4fa3-85cd-660f7c8b3aef None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:37.124204 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d2565-b3e9-4fa3-85cd-660f7c8b3aef None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:37.125476 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 567/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:08:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:08:37.130288 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582704bf-1a55-4fde-9af2-c17e43f71ec0 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:37.130727 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582704bf-1a55-4fde-9af2-c17e43f71ec0 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:37.130851 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582704bf-1a55-4fde-9af2-c17e43f71ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:37.150122 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-582704bf-1a55-4fde-9af2-c17e43f71ec0 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:08:37.151364 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-582704bf-1a55-4fde-9af2-c17e43f71ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:08:37.209771 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 562/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:08:37 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:08:37.372266 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d2565-b3e9-4fa3-85cd-660f7c8b3aef None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:08:37.374266 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-8b7d2565-b3e9-4fa3-85cd-660f7c8b3aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:08:37.453380 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d2565-b3e9-4fa3-85cd-660f7c8b3aef None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:08:37.461060 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d59ced-3f75-424a-b9b3-ef68936f8d59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:08:37.465520 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d59ced-3f75-424a-b9b3-ef68936f8d59 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:37.465520 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d59ced-3f75-424a-b9b3-ef68936f8d59 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:37.465520 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d59ced-3f75-424a-b9b3-ef68936f8d59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:37.473192 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d59ced-3f75-424a-b9b3-ef68936f8d59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:08:37.474789 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d59ced-3f75-424a-b9b3-ef68936f8d59 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:08:37.484728 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 568/1130] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:08:37 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:08:38.331570 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f76c2d-b3bb-456c-bdc1-11e95f6de0d1 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:38.332066 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f76c2d-b3bb-456c-bdc1-11e95f6de0d1 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:38.332169 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f76c2d-b3bb-456c-bdc1-11e95f6de0d1 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:38.333433 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 563/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:08:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:08:38.338314 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06c3f6-b6d5-4891-8bf0-320e324e3cd5 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:38.338762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06c3f6-b6d5-4891-8bf0-320e324e3cd5 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:38.338887 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06c3f6-b6d5-4891-8bf0-320e324e3cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:38.357843 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-cb06c3f6-b6d5-4891-8bf0-320e324e3cd5 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:08:38.374044 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-cb06c3f6-b6d5-4891-8bf0-320e324e3cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:08:38.374044 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 569/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:08:38 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:08:38.524879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f76c2d-b3bb-456c-bdc1-11e95f6de0d1 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:08:38.538361 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f76c2d-b3bb-456c-bdc1-11e95f6de0d1 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:08:38.543282 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d506d-dbd1-4c10-9659-e3f0b304e620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:08:38.543869 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d506d-dbd1-4c10-9659-e3f0b304e620 service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:38.544152 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d506d-dbd1-4c10-9659-e3f0b304e620 service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:38.544428 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d506d-dbd1-4c10-9659-e3f0b304e620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:38.553207 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d506d-dbd1-4c10-9659-e3f0b304e620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:08:38.554786 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d506d-dbd1-4c10-9659-e3f0b304e620 service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:08:38.564858 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 564/1133] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:08:38 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:08:47.791451 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a076eb-dd83-4933-8742-41fbc13bfe52 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:47.792043 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a076eb-dd83-4933-8742-41fbc13bfe52 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:47.792043 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a076eb-dd83-4933-8742-41fbc13bfe52 None None] PATH_INFO: `/v3` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:47.793312 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 570/1134] 10.222.0.123 () {54 vars in 930 bytes} [Fri Aug 26 01:08:47 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 01:08:47.800015 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd9742-5d5c-4be9-a06e-c2ff4674b631 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:47.800467 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd9742-5d5c-4be9-a06e-c2ff4674b631 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:47.800571 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd9742-5d5c-4be9-a06e-c2ff4674b631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:47.820449 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-48dd9742-5d5c-4be9-a06e-c2ff4674b631 None None] MFA Rules not processed for user `49070d8a078644f4a9e17deab052ba41`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:08:47.821643 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-48dd9742-5d5c-4be9-a06e-c2ff4674b631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:08:47.883893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 565/1135] 10.222.0.123 () {58 vars in 1020 bytes} [Fri Aug 26 01:08:47 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:08:48.352564 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=35 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:08:49.816493 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bbda3-1f26-4268-8222-659501752c3b None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:49.817150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bbda3-1f26-4268-8222-659501752c3b None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:49.817150 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bbda3-1f26-4268-8222-659501752c3b None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:49.818367 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 571/1136] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:08:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:08:49.823397 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d4b3c-8308-4ab0-8d62-dc0931bcb3d4 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:49.823830 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d4b3c-8308-4ab0-8d62-dc0931bcb3d4 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:49.823929 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d4b3c-8308-4ab0-8d62-dc0931bcb3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:49.842974 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-898d4b3c-8308-4ab0-8d62-dc0931bcb3d4 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:08:49.844679 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-898d4b3c-8308-4ab0-8d62-dc0931bcb3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:08:49.852303 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 566/1137] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:08:49 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:08:50.011921 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bbda3-1f26-4268-8222-659501752c3b None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:08:50.025472 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bbda3-1f26-4268-8222-659501752c3b None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:08:50.030354 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844ec51-21b0-4044-9a94-af2885cf5572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:08:50.030988 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844ec51-21b0-4044-9a94-af2885cf5572 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:50.031778 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844ec51-21b0-4044-9a94-af2885cf5572 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:50.032050 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844ec51-21b0-4044-9a94-af2885cf5572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:50.040148 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844ec51-21b0-4044-9a94-af2885cf5572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:08:50.041731 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844ec51-21b0-4044-9a94-af2885cf5572 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:08:50.051927 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 572/1138] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:08:50 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:08:50.886111 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee75b39-93eb-47f1-9450-6091964e384b None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:50.886632 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee75b39-93eb-47f1-9450-6091964e384b None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:50.886632 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee75b39-93eb-47f1-9450-6091964e384b None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:50.887972 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 567/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:08:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:08:50.893415 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f99656-c7cf-4719-bb9c-f18ebe72796e None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:50.893841 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f99656-c7cf-4719-bb9c-f18ebe72796e None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:50.893972 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f99656-c7cf-4719-bb9c-f18ebe72796e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:50.913541 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-34f99656-c7cf-4719-bb9c-f18ebe72796e None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:08:50.914740 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-34f99656-c7cf-4719-bb9c-f18ebe72796e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:08:50.923156 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 573/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:08:50 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:08:51.084278 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee75b39-93eb-47f1-9450-6091964e384b None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:08:51.097784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee75b39-93eb-47f1-9450-6091964e384b None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:08:51.102656 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efbc77-ccb7-4f46-a479-d336c3cf8bf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:08:51.103281 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efbc77-ccb7-4f46-a479-d336c3cf8bf5 service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:08:51.103561 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efbc77-ccb7-4f46-a479-d336c3cf8bf5 service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:08:51.103833 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efbc77-ccb7-4f46-a479-d336c3cf8bf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:08:51.112403 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efbc77-ccb7-4f46-a479-d336c3cf8bf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:08:51.113981 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efbc77-ccb7-4f46-a479-d336c3cf8bf5 service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:08:51.123367 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 568/1141] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:08:51 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:09:00.908754 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=9 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:09:00.929162 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c88e3-9403-4fc2-a21e-1b9fcacc880f None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:00.929448 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c88e3-9403-4fc2-a21e-1b9fcacc880f None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:00.929725 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c88e3-9403-4fc2-a21e-1b9fcacc880f None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:00.931094 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 574/1142] 10.222.0.121 () {54 vars in 966 bytes} [Fri Aug 26 01:09:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:09:00.937022 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fdb30-8ad6-4e6b-a2d3-f21392c309c8 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:00.937478 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fdb30-8ad6-4e6b-a2d3-f21392c309c8 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:00.937588 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fdb30-8ad6-4e6b-a2d3-f21392c309c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:00.945164 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=72 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:09:00.957211 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-c90fdb30-8ad6-4e6b-a2d3-f21392c309c8 None None] MFA Rules not processed for user `49070d8a078644f4a9e17deab052ba41`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:09:00.958410 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-c90fdb30-8ad6-4e6b-a2d3-f21392c309c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:09:00.967105 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 569/1143] 10.222.0.121 () {58 vars in 1063 bytes} [Fri Aug 26 01:09:00 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:09:00.974457 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c88e3-9403-4fc2-a21e-1b9fcacc880f None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:09:00.988096 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c88e3-9403-4fc2-a21e-1b9fcacc880f None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:09:00.993043 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b8f40-abca-4f03-bb3a-5f57297a5fa6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49070d8a078644f4a9e17deab052ba41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:09:00.993627 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b8f40-abca-4f03-bb3a-5f57297a5fa6 service placement] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:00.993908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b8f40-abca-4f03-bb3a-5f57297a5fa6 service placement] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:00.994182 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b8f40-abca-4f03-bb3a-5f57297a5fa6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:01.003016 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b8f40-abca-4f03-bb3a-5f57297a5fa6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:09:01.004655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b8f40-abca-4f03-bb3a-5f57297a5fa6 service placement] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:09:01.014189 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 575/1144] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:09:00 2022] GET /identity/v3/auth/tokens => generated 2876 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:09:02.359383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f2f90-2772-4870-a5b9-eda70789e715 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:02.359946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f2f90-2772-4870-a5b9-eda70789e715 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:02.359946 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f2f90-2772-4870-a5b9-eda70789e715 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:02.361315 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 570/1145] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:09:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:09:02.366211 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ef45-cdc4-43a3-98cf-a1778280e83e None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:02.366618 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ef45-cdc4-43a3-98cf-a1778280e83e None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:02.366767 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ef45-cdc4-43a3-98cf-a1778280e83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:02.385820 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-b697ef45-cdc4-43a3-98cf-a1778280e83e None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:09:02.387066 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-b697ef45-cdc4-43a3-98cf-a1778280e83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:09:02.395406 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 576/1146] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:09:02 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:09:02.558565 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f2f90-2772-4870-a5b9-eda70789e715 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:09:02.572609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f2f90-2772-4870-a5b9-eda70789e715 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:09:02.578024 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ced64-7fd5-4e78-be33-de5cb1f26c10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:09:02.578611 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ced64-7fd5-4e78-be33-de5cb1f26c10 service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:02.578931 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ced64-7fd5-4e78-be33-de5cb1f26c10 service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:02.579208 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ced64-7fd5-4e78-be33-de5cb1f26c10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:02.587349 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ced64-7fd5-4e78-be33-de5cb1f26c10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:09:02.588930 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ced64-7fd5-4e78-be33-de5cb1f26c10 service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:09:02.598351 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 571/1147] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:09:02 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:09:03.427836 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dd280-bdb2-435c-9ee6-ceefdad974c2 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:03.427836 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dd280-bdb2-435c-9ee6-ceefdad974c2 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:03.427836 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dd280-bdb2-435c-9ee6-ceefdad974c2 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:03.428578 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 577/1148] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 01:09:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:09:03.433349 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee5949-62a8-4588-95f5-dfd625b8ce0a None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:03.435893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee5949-62a8-4588-95f5-dfd625b8ce0a None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:03.435893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee5949-62a8-4588-95f5-dfd625b8ce0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:03.454171 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-f2ee5949-62a8-4588-95f5-dfd625b8ce0a None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:09:03.455418 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-f2ee5949-62a8-4588-95f5-dfd625b8ce0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:09:03.463489 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 572/1149] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 01:09:03 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:09:03.619739 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dd280-bdb2-435c-9ee6-ceefdad974c2 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:09:03.633802 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dd280-bdb2-435c-9ee6-ceefdad974c2 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:09:03.638770 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b22c2-ea5d-4a3b-8b61-c72529863a11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:09:03.640000 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b22c2-ea5d-4a3b-8b61-c72529863a11 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:03.640275 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b22c2-ea5d-4a3b-8b61-c72529863a11 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:03.640548 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b22c2-ea5d-4a3b-8b61-c72529863a11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:03.648565 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b22c2-ea5d-4a3b-8b61-c72529863a11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:09:03.650156 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b22c2-ea5d-4a3b-8b61-c72529863a11 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:09:03.659523 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 578/1150] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:09:03 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:09:07.817214 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36cebb-ffac-4a02-847a-f0366c81217f None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:07.817855 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36cebb-ffac-4a02-847a-f0366c81217f None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:07.817855 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36cebb-ffac-4a02-847a-f0366c81217f None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:07.819146 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 573/1151] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:09:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:09:07.824275 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f77a37-0d63-46a6-abe4-8893eadb82a6 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:07.824726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f77a37-0d63-46a6-abe4-8893eadb82a6 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:07.824862 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f77a37-0d63-46a6-abe4-8893eadb82a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:07.844596 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-e7f77a37-0d63-46a6-abe4-8893eadb82a6 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:09:07.846540 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-e7f77a37-0d63-46a6-abe4-8893eadb82a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:09:07.853657 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 579/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:09:07 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:09:08.228324 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36cebb-ffac-4a02-847a-f0366c81217f None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:09:08.230028 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-ff36cebb-ffac-4a02-847a-f0366c81217f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:09:08.286873 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36cebb-ffac-4a02-847a-f0366c81217f None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:09:08.290308 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b39a4-b2b6-4479-a170-e99188244536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:09:08.290940 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b39a4-b2b6-4479-a170-e99188244536 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:08.291218 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b39a4-b2b6-4479-a170-e99188244536 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:08.291487 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b39a4-b2b6-4479-a170-e99188244536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:08.301712 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b39a4-b2b6-4479-a170-e99188244536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:09:08.303282 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b39a4-b2b6-4479-a170-e99188244536 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:09:08.312956 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 574/1153] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:09:08 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:09:10.527416 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de80a6b-c7b4-45a7-b631-a0b6d73d52e8 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:10.528074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de80a6b-c7b4-45a7-b631-a0b6d73d52e8 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:10.528074 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de80a6b-c7b4-45a7-b631-a0b6d73d52e8 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:10.529332 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 580/1154] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:09:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:09:10.534785 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53426f-ef4d-4f8e-b58f-a262dbb2388a None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:10.535261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53426f-ef4d-4f8e-b58f-a262dbb2388a None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:10.535369 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53426f-ef4d-4f8e-b58f-a262dbb2388a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:10.555413 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-cc53426f-ef4d-4f8e-b58f-a262dbb2388a None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:09:10.556613 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-cc53426f-ef4d-4f8e-b58f-a262dbb2388a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:09:10.565072 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 575/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:09:10 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:09:10.915093 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de80a6b-c7b4-45a7-b631-a0b6d73d52e8 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:09:10.926877 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de80a6b-c7b4-45a7-b631-a0b6d73d52e8 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:09:10.930522 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47445f47-1d28-4892-be55-a7dd0b6a1cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:09:10.931146 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47445f47-1d28-4892-be55-a7dd0b6a1cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:10.931426 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47445f47-1d28-4892-be55-a7dd0b6a1cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:10.931698 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47445f47-1d28-4892-be55-a7dd0b6a1cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:10.940340 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47445f47-1d28-4892-be55-a7dd0b6a1cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:09:10.941759 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47445f47-1d28-4892-be55-a7dd0b6a1cb3 service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:09:10.950984 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 581/1156] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:09:10 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:09:14.632303 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3779b-b0f3-4227-91d4-b3a814313285 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:14.632871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3779b-b0f3-4227-91d4-b3a814313285 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:14.632871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3779b-b0f3-4227-91d4-b3a814313285 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:14.634183 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 576/1157] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:09:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:09:14.639526 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678be9b9-4efa-4244-a072-2a9dbd936cbd None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:14.639931 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678be9b9-4efa-4244-a072-2a9dbd936cbd None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:14.640085 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678be9b9-4efa-4244-a072-2a9dbd936cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:14.659510 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-678be9b9-4efa-4244-a072-2a9dbd936cbd None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:09:14.660705 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-678be9b9-4efa-4244-a072-2a9dbd936cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:09:14.668413 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 582/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:09:14 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:09:15.252792 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3779b-b0f3-4227-91d4-b3a814313285 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:09:15.254451 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-f5e3779b-b0f3-4227-91d4-b3a814313285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:09:15.312838 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3779b-b0f3-4227-91d4-b3a814313285 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:09:15.316432 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea890d-2600-4e0a-b6aa-e72d4d6631d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48c6b8ef7284907bbfd5b48e2b58516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:09:15.317025 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea890d-2600-4e0a-b6aa-e72d4d6631d0 service cinder] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:15.317299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea890d-2600-4e0a-b6aa-e72d4d6631d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:15.317567 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea890d-2600-4e0a-b6aa-e72d4d6631d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:15.327295 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea890d-2600-4e0a-b6aa-e72d4d6631d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:09:15.328731 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea890d-2600-4e0a-b6aa-e72d4d6631d0 service cinder] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:09:15.337924 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 577/1159] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:09:15 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:09:17.547502 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3708e-8577-47a1-8bdd-0dc20eaa4dc1 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:17.548028 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3708e-8577-47a1-8bdd-0dc20eaa4dc1 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:17.548028 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3708e-8577-47a1-8bdd-0dc20eaa4dc1 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:17.549762 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 583/1160] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 01:09:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:09:17.556938 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40af7e5-0865-4aa8-912d-a4a4b488363f None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:17.557578 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40af7e5-0865-4aa8-912d-a4a4b488363f None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:17.557578 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40af7e5-0865-4aa8-912d-a4a4b488363f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:17.577045 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-e40af7e5-0865-4aa8-912d-a4a4b488363f None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:09:17.578230 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-e40af7e5-0865-4aa8-912d-a4a4b488363f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:09:17.585843 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 578/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 01:09:17 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:09:18.159498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3708e-8577-47a1-8bdd-0dc20eaa4dc1 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:09:18.161151 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-d8f3708e-8577-47a1-8bdd-0dc20eaa4dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:09:18.174149 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3708e-8577-47a1-8bdd-0dc20eaa4dc1 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:09:18.177586 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c45e7-8784-49d5-ba50-f1ccc2e9dfda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48c6b8ef7284907bbfd5b48e2b58516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:09:18.178202 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c45e7-8784-49d5-ba50-f1ccc2e9dfda service cinder] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:09:18.178481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c45e7-8784-49d5-ba50-f1ccc2e9dfda service cinder] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:09:18.178769 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c45e7-8784-49d5-ba50-f1ccc2e9dfda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:09:18.187590 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c45e7-8784-49d5-ba50-f1ccc2e9dfda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:09:18.188998 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c45e7-8784-49d5-ba50-f1ccc2e9dfda service cinder] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:09:18.198155 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 584/1162] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:09:18 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:09:27.572330 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=69 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:09:28.194153 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=33 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:39.811364 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58b10b-0b66-4f21-be65-3ffbb020e011 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:39.811993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58b10b-0b66-4f21-be65-3ffbb020e011 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:39.811993 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58b10b-0b66-4f21-be65-3ffbb020e011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:39.815118 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1456830-2cda-4e21-8ac1-a720e2c38b44 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:39.815561 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1456830-2cda-4e21-8ac1-a720e2c38b44 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:39.815661 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1456830-2cda-4e21-8ac1-a720e2c38b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:39.832738 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-dd58b10b-0b66-4f21-be65-3ffbb020e011 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:10:39.833954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-dd58b10b-0b66-4f21-be65-3ffbb020e011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:10:39.834344 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-c1456830-2cda-4e21-8ac1-a720e2c38b44 None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:10:39.835549 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-c1456830-2cda-4e21-8ac1-a720e2c38b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:10:39.842058 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 579/1163] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:10:39 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:10:39.843471 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 585/1164] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:10:39 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:10:39.851345 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209bfa6-8cb4-4f77-8910-1f4ba51303cd None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:39.851515 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a3cb2-01bb-4038-9621-c5c53a150cfe None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:39.851636 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a3cb2-01bb-4038-9621-c5c53a150cfe None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:39.851739 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209bfa6-8cb4-4f77-8910-1f4ba51303cd None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:39.851901 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a3cb2-01bb-4038-9621-c5c53a150cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:39.852013 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209bfa6-8cb4-4f77-8910-1f4ba51303cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:39.871968 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-e53a3cb2-01bb-4038-9621-c5c53a150cfe None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:10:39.873086 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-9209bfa6-8cb4-4f77-8910-1f4ba51303cd None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:10:39.873213 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-e53a3cb2-01bb-4038-9621-c5c53a150cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:10:39.874273 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-9209bfa6-8cb4-4f77-8910-1f4ba51303cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:10:39.881107 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 580/1165] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:10:39 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:10:39.881975 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 586/1166] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:10:39 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:10:39.885493 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a3cb2-01bb-4038-9621-c5c53a150cfe None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:39.886259 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209bfa6-8cb4-4f77-8910-1f4ba51303cd None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:39.895051 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a3cb2-01bb-4038-9621-c5c53a150cfe None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:39.895366 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209bfa6-8cb4-4f77-8910-1f4ba51303cd None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:39.899632 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa972d7b-f673-4daf-b37f-2e90c50c139e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:39.900224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f50b1b-97bd-4e40-9c9f-b7a654df0ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:39.900357 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa972d7b-f673-4daf-b37f-2e90c50c139e admin admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:39.900507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa972d7b-f673-4daf-b37f-2e90c50c139e admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:39.900767 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa972d7b-f673-4daf-b37f-2e90c50c139e admin admin] PATH_INFO: `/v3/domains` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:39.900891 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f50b1b-97bd-4e40-9c9f-b7a654df0ffc admin admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:39.901083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f50b1b-97bd-4e40-9c9f-b7a654df0ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:39.901356 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f50b1b-97bd-4e40-9c9f-b7a654df0ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:39.901464 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa972d7b-f673-4daf-b37f-2e90c50c139e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88530) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 01:10:39.901725 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa972d7b-f673-4daf-b37f-2e90c50c139e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:39.901988 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f50b1b-97bd-4e40-9c9f-b7a654df0ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88531) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 01:10:39.902290 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f50b1b-97bd-4e40-9c9f-b7a654df0ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:39.903325 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: WARNING py.warnings [None req-43f50b1b-97bd-4e40-9c9f-b7a654df0ffc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:10:39.903325 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: warnings.warn(msg) Aug 26 01:10:39.903325 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: Aug 26 01:10:39.903588 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa972d7b-f673-4daf-b37f-2e90c50c139e admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:39.904203 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f50b1b-97bd-4e40-9c9f-b7a654df0ffc admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:39.915122 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 581/1167] 10.222.0.121 () {58 vars in 1158 bytes} [Fri Aug 26 01:10:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 01:10:39.922079 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 587/1168] 10.222.0.121 () {58 vars in 1158 bytes} [Fri Aug 26 01:10:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 01:10:39.924233 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa972d7b-f673-4daf-b37f-2e90c50c139e admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:39.925197 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f50b1b-97bd-4e40-9c9f-b7a654df0ffc admin admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:39.935588 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa972d7b-f673-4daf-b37f-2e90c50c139e admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:39.935903 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f50b1b-97bd-4e40-9c9f-b7a654df0ffc admin admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:39.940229 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943af542-db85-47ba-a573-1b40279f6721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:39.940625 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb866a-4a9f-4bbd-83ee-b96ff945b3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:39.940829 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943af542-db85-47ba-a573-1b40279f6721 admin admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:39.941110 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943af542-db85-47ba-a573-1b40279f6721 admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:39.941219 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb866a-4a9f-4bbd-83ee-b96ff945b3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:39.941383 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943af542-db85-47ba-a573-1b40279f6721 admin admin] PATH_INFO: `/v3/projects` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:39.941485 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb866a-4a9f-4bbd-83ee-b96ff945b3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:39.941727 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb866a-4a9f-4bbd-83ee-b96ff945b3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:39.942020 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943af542-db85-47ba-a573-1b40279f6721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:39.942338 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb866a-4a9f-4bbd-83ee-b96ff945b3e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:39.943081 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: WARNING py.warnings [None req-943af542-db85-47ba-a573-1b40279f6721 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:10:39.943081 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: warnings.warn(msg) Aug 26 01:10:39.943081 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: Aug 26 01:10:39.944263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb866a-4a9f-4bbd-83ee-b96ff945b3e1 admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:39.944390 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943af542-db85-47ba-a573-1b40279f6721 admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:40.067361 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 588/1169] 10.222.0.121 () {60 vars in 1158 bytes} [Fri Aug 26 01:10:39 2022] POST /identity/v3/projects => generated 378 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 01:10:40.071558 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb866a-4a9f-4bbd-83ee-b96ff945b3e1 admin admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:40.097971 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 582/1170] 10.222.0.121 () {60 vars in 1158 bytes} [Fri Aug 26 01:10:39 2022] POST /identity/v3/projects => generated 386 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 01:10:40.102049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943af542-db85-47ba-a573-1b40279f6721 admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:40.134459 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb866a-4a9f-4bbd-83ee-b96ff945b3e1 admin admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:40.164675 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943af542-db85-47ba-a573-1b40279f6721 admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:40.169526 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89a362-4998-443e-bac4-6d462201b2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:40.170119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89a362-4998-443e-bac4-6d462201b2da admin admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:40.170397 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89a362-4998-443e-bac4-6d462201b2da admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:40.170663 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89a362-4998-443e-bac4-6d462201b2da admin admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:40.171311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89a362-4998-443e-bac4-6d462201b2da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:40.173271 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89a362-4998-443e-bac4-6d462201b2da admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:40.192897 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ed8d3-0269-4fbe-ad5c-18d1d69d2bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:40.199040 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ed8d3-0269-4fbe-ad5c-18d1d69d2bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:40.199040 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ed8d3-0269-4fbe-ad5c-18d1d69d2bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:40.199040 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ed8d3-0269-4fbe-ad5c-18d1d69d2bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:40.199040 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ed8d3-0269-4fbe-ad5c-18d1d69d2bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:40.199040 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: WARNING py.warnings [None req-4d5ed8d3-0269-4fbe-ad5c-18d1d69d2bf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:10:40.199040 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: warnings.warn(msg) Aug 26 01:10:40.199040 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: Aug 26 01:10:40.199654 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ed8d3-0269-4fbe-ad5c-18d1d69d2bf5 admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:40.300596 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 583/1171] 10.222.0.121 () {60 vars in 1149 bytes} [Fri Aug 26 01:10:40 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 01:10:40.304554 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89a362-4998-443e-bac4-6d462201b2da admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:40.315225 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89a362-4998-443e-bac4-6d462201b2da admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:40.319199 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 589/1172] 10.222.0.121 () {60 vars in 1149 bytes} [Fri Aug 26 01:10:40 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 01:10:40.319904 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effa57c-32a9-4e25-99cb-aebedc0baf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:40.320304 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ed8d3-0269-4fbe-ad5c-18d1d69d2bf5 admin admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:40.320541 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effa57c-32a9-4e25-99cb-aebedc0baf5a admin admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:40.320817 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effa57c-32a9-4e25-99cb-aebedc0baf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:40.321089 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effa57c-32a9-4e25-99cb-aebedc0baf5a admin admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:40.321713 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effa57c-32a9-4e25-99cb-aebedc0baf5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:40.323335 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effa57c-32a9-4e25-99cb-aebedc0baf5a admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:40.330176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ed8d3-0269-4fbe-ad5c-18d1d69d2bf5 admin admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:40.333749 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 584/1173] 10.222.0.121 () {58 vars in 1127 bytes} [Fri Aug 26 01:10:40 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 01:10:40.334976 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de9eec-0a00-49d3-a471-109194c7abbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:40.335573 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de9eec-0a00-49d3-a471-109194c7abbd admin admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:40.335853 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de9eec-0a00-49d3-a471-109194c7abbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:40.336131 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de9eec-0a00-49d3-a471-109194c7abbd admin admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:40.336802 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de9eec-0a00-49d3-a471-109194c7abbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:40.337566 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effa57c-32a9-4e25-99cb-aebedc0baf5a admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:40.338360 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de9eec-0a00-49d3-a471-109194c7abbd admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:40.347542 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effa57c-32a9-4e25-99cb-aebedc0baf5a admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:40.349144 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 590/1174] 10.222.0.121 () {58 vars in 1127 bytes} [Fri Aug 26 01:10:40 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 01:10:40.352480 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bee865-0390-4fb4-aa96-1ece07e8b08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:40.352745 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de9eec-0a00-49d3-a471-109194c7abbd admin admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:40.353082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bee865-0390-4fb4-aa96-1ece07e8b08d admin admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:40.353363 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bee865-0390-4fb4-aa96-1ece07e8b08d admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:40.353637 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bee865-0390-4fb4-aa96-1ece07e8b08d admin admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:40.354795 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bee865-0390-4fb4-aa96-1ece07e8b08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:40.356449 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bee865-0390-4fb4-aa96-1ece07e8b08d admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:40.362941 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de9eec-0a00-49d3-a471-109194c7abbd admin admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:40.367708 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 585/1175] 10.222.0.121 () {58 vars in 1127 bytes} [Fri Aug 26 01:10:40 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 01:10:40.367957 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0036ae-f0eb-4be2-a43e-a924aa87e79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:40.368405 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0036ae-f0eb-4be2-a43e-a924aa87e79e admin admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:40.368687 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0036ae-f0eb-4be2-a43e-a924aa87e79e admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:40.368961 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0036ae-f0eb-4be2-a43e-a924aa87e79e admin admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:40.369589 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0036ae-f0eb-4be2-a43e-a924aa87e79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:40.371814 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0036ae-f0eb-4be2-a43e-a924aa87e79e admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:40.372417 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bee865-0390-4fb4-aa96-1ece07e8b08d admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:40.382973 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 591/1176] 10.222.0.121 () {58 vars in 1127 bytes} [Fri Aug 26 01:10:40 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 01:10:40.383430 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bee865-0390-4fb4-aa96-1ece07e8b08d admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:40.387068 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0036ae-f0eb-4be2-a43e-a924aa87e79e admin admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:40.389098 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade22e88-938c-45e5-b41d-1384926b5e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:40.389768 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade22e88-938c-45e5-b41d-1384926b5e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:40.390049 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade22e88-938c-45e5-b41d-1384926b5e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:40.390325 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade22e88-938c-45e5-b41d-1384926b5e5e admin admin] PATH_INFO: `/v3/projects/9ff5860548774b98b658fc8423eacf82/users/dfd67fde6d23497ba4bd2a672069ad30/roles/8acc6a2016c149a0b80cf3c56b5ae91a` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:40.397323 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0036ae-f0eb-4be2-a43e-a924aa87e79e admin admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:40.402192 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f2981-fc36-4d63-9464-096974998f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:40.402906 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f2981-fc36-4d63-9464-096974998f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:40.403141 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f2981-fc36-4d63-9464-096974998f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:40.403420 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f2981-fc36-4d63-9464-096974998f05 admin admin] PATH_INFO: `/v3/projects/8f52bc1031a449258046cb689e90e74e/users/b57c5c79071a42e8b98599cea4190eee/roles/8acc6a2016c149a0b80cf3c56b5ae91a` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:40.405279 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade22e88-938c-45e5-b41d-1384926b5e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff5860548774b98b658fc8423eacf82, user_id=dfd67fde6d23497ba4bd2a672069ad30, role_id=8acc6a2016c149a0b80cf3c56b5ae91a)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:40.406415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: WARNING py.warnings [None req-ade22e88-938c-45e5-b41d-1384926b5e5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:10:40.406415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: warnings.warn(msg) Aug 26 01:10:40.406415 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: Aug 26 01:10:40.408807 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade22e88-938c-45e5-b41d-1384926b5e5e admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:40.418656 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f2981-fc36-4d63-9464-096974998f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f52bc1031a449258046cb689e90e74e, user_id=b57c5c79071a42e8b98599cea4190eee, role_id=8acc6a2016c149a0b80cf3c56b5ae91a)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:40.421440 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f2981-fc36-4d63-9464-096974998f05 admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:40.523349 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 586/1177] 10.222.0.121 () {60 vars in 1488 bytes} [Fri Aug 26 01:10:40 2022] PUT /identity/v3/projects/9ff5860548774b98b658fc8423eacf82/users/dfd67fde6d23497ba4bd2a672069ad30/roles/8acc6a2016c149a0b80cf3c56b5ae91a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 01:10:40.528408 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b838c-e482-4ad2-bea2-57c204adf71e None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:40.528696 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b838c-e482-4ad2-bea2-57c204adf71e None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:40.528975 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b838c-e482-4ad2-bea2-57c204adf71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:40.547727 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-c81b838c-e482-4ad2-bea2-57c204adf71e None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:10:40.548928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-c81b838c-e482-4ad2-bea2-57c204adf71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:10:40.552463 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 592/1178] 10.222.0.121 () {60 vars in 1488 bytes} [Fri Aug 26 01:10:40 2022] PUT /identity/v3/projects/8f52bc1031a449258046cb689e90e74e/users/b57c5c79071a42e8b98599cea4190eee/roles/8acc6a2016c149a0b80cf3c56b5ae91a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:10:40.558216 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff48c8f-49f1-41ff-b0f3-c09c29e37c8a None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:40.558510 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff48c8f-49f1-41ff-b0f3-c09c29e37c8a None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:40.558903 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff48c8f-49f1-41ff-b0f3-c09c29e37c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:40.566092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:40.578097 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-cff48c8f-49f1-41ff-b0f3-c09c29e37c8a None None] MFA Rules not processed for user `5579ecb3986c47e1b18c2e33e293c21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:10:40.579413 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-cff48c8f-49f1-41ff-b0f3-c09c29e37c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:10:40.597758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:40.609765 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 587/1179] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:10:40 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:10:40.623272 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b838c-e482-4ad2-bea2-57c204adf71e None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:40.640724 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 593/1180] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:10:40 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:10:40.650791 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff48c8f-49f1-41ff-b0f3-c09c29e37c8a None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:40.674629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b838c-e482-4ad2-bea2-57c204adf71e None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:40.678690 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f5539-78e3-4fb4-b0e5-dd76cdd48a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:40.679367 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f5539-78e3-4fb4-b0e5-dd76cdd48a71 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:40.679788 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f5539-78e3-4fb4-b0e5-dd76cdd48a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:40.680065 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f5539-78e3-4fb4-b0e5-dd76cdd48a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:40.690128 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f5539-78e3-4fb4-b0e5-dd76cdd48a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:40.691624 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f5539-78e3-4fb4-b0e5-dd76cdd48a71 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:40.701766 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 588/1181] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:10:40 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:10:40.715293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff48c8f-49f1-41ff-b0f3-c09c29e37c8a None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:40.715293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf940cde-c092-4ac4-9505-451a212f6df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:40.715293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf940cde-c092-4ac4-9505-451a212f6df7 service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:40.715293 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf940cde-c092-4ac4-9505-451a212f6df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:40.715796 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf940cde-c092-4ac4-9505-451a212f6df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:40.725195 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf940cde-c092-4ac4-9505-451a212f6df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:40.728047 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf940cde-c092-4ac4-9505-451a212f6df7 service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:40.742954 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 594/1182] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:10:40 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:10:47.535112 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5727e5-86db-4592-811a-78b400e69a15 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:47.535609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5727e5-86db-4592-811a-78b400e69a15 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:47.535702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5727e5-86db-4592-811a-78b400e69a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:47.603398 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-ce5727e5-86db-4592-811a-78b400e69a15 None None] MFA Rules not processed for user `dfd67fde6d23497ba4bd2a672069ad30`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:10:47.604638 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-ce5727e5-86db-4592-811a-78b400e69a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:10:47.717585 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 589/1183] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:10:47 2022] POST /identity/v3/auth/tokens => generated 2830 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:10:47.723766 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf940cde-c092-4ac4-9505-451a212f6df7 service neutron] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:47.740992 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf940cde-c092-4ac4-9505-451a212f6df7 service neutron] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:47.748147 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c48a9-5a2c-444b-aed7-1402881ded9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:47.749095 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c48a9-5a2c-444b-aed7-1402881ded9b admin admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:47.755099 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c48a9-5a2c-444b-aed7-1402881ded9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:47.755099 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c48a9-5a2c-444b-aed7-1402881ded9b admin admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:47.755099 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c48a9-5a2c-444b-aed7-1402881ded9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:47.755099 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c48a9-5a2c-444b-aed7-1402881ded9b admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:47.878346 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 595/1184] 10.222.0.121 () {60 vars in 1158 bytes} [Fri Aug 26 01:10:47 2022] POST /identity/v3/projects => generated 386 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 01:10:47.882271 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5727e5-86db-4592-811a-78b400e69a15 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:47.902106 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5727e5-86db-4592-811a-78b400e69a15 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:47.995902 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190da16-5516-4d1e-93e0-d70d9b887235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:47.996523 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190da16-5516-4d1e-93e0-d70d9b887235 admin admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:47.996846 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190da16-5516-4d1e-93e0-d70d9b887235 admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:47.997117 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190da16-5516-4d1e-93e0-d70d9b887235 admin admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:47.997758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190da16-5516-4d1e-93e0-d70d9b887235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:47.999870 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190da16-5516-4d1e-93e0-d70d9b887235 admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:48.142887 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 590/1185] 10.222.0.121 () {60 vars in 1149 bytes} [Fri Aug 26 01:10:47 2022] POST /identity/v3/users => generated 300 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 01:10:48.146843 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c48a9-5a2c-444b-aed7-1402881ded9b admin admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:48.161581 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c48a9-5a2c-444b-aed7-1402881ded9b admin admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:48.168742 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c47d1-253a-4abe-a175-75bccec41fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:48.169422 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c47d1-253a-4abe-a175-75bccec41fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:48.169712 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c47d1-253a-4abe-a175-75bccec41fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:48.170317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c47d1-253a-4abe-a175-75bccec41fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:48.171181 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c47d1-253a-4abe-a175-75bccec41fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:48.173044 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c47d1-253a-4abe-a175-75bccec41fb8 admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:48.187678 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 596/1186] 10.222.0.121 () {58 vars in 1127 bytes} [Fri Aug 26 01:10:48 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 01:10:48.193077 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190da16-5516-4d1e-93e0-d70d9b887235 admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:48.206693 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190da16-5516-4d1e-93e0-d70d9b887235 admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:48.218779 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736850c-1bb6-4d59-b809-1ea30d0c3708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:48.219585 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736850c-1bb6-4d59-b809-1ea30d0c3708 admin admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:48.219941 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736850c-1bb6-4d59-b809-1ea30d0c3708 admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:48.220289 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736850c-1bb6-4d59-b809-1ea30d0c3708 admin admin] PATH_INFO: `/v3/projects/061ae6e6d5d948169036bad7e228c59d/users/c5fb378caccb4baf9d663ab22aaa7751/roles/e73a8fc0684c4f6083a71ea9a85c7298` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:48.248182 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736850c-1bb6-4d59-b809-1ea30d0c3708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=061ae6e6d5d948169036bad7e228c59d, user_id=c5fb378caccb4baf9d663ab22aaa7751, role_id=e73a8fc0684c4f6083a71ea9a85c7298)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:48.254143 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736850c-1bb6-4d59-b809-1ea30d0c3708 admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:48.257232 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:48.359308 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bffe5-e8d2-4158-85eb-82f88ec265c0 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:48.359666 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bffe5-e8d2-4158-85eb-82f88ec265c0 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:48.359947 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bffe5-e8d2-4158-85eb-82f88ec265c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:48.363439 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 591/1187] 10.222.0.121 () {60 vars in 1488 bytes} [Fri Aug 26 01:10:48 2022] PUT /identity/v3/projects/061ae6e6d5d948169036bad7e228c59d/users/c5fb378caccb4baf9d663ab22aaa7751/roles/e73a8fc0684c4f6083a71ea9a85c7298 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:10:48.366563 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736850c-1bb6-4d59-b809-1ea30d0c3708 admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:48.409732 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-838bffe5-e8d2-4158-85eb-82f88ec265c0 None None] MFA Rules not processed for user `b57c5c79071a42e8b98599cea4190eee`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:10:48.411020 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-838bffe5-e8d2-4158-85eb-82f88ec265c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:10:48.447247 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736850c-1bb6-4d59-b809-1ea30d0c3708 admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:48.455854 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61293342-a87d-4ffd-b9a1-000274464045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:48.456694 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61293342-a87d-4ffd-b9a1-000274464045 admin admin] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:48.457127 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61293342-a87d-4ffd-b9a1-000274464045 admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:48.457548 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61293342-a87d-4ffd-b9a1-000274464045 admin admin] PATH_INFO: `/v3/roles` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:48.458371 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61293342-a87d-4ffd-b9a1-000274464045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:48.460220 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61293342-a87d-4ffd-b9a1-000274464045 admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:48.482145 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 592/1188] 10.222.0.121 () {58 vars in 1127 bytes} [Fri Aug 26 01:10:48 2022] GET /identity/v3/roles => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 01:10:48.493320 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61293342-a87d-4ffd-b9a1-000274464045 admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:48.507299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61293342-a87d-4ffd-b9a1-000274464045 admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:48.519620 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba87bef-82bc-4e04-80cc-c8f6274c9a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:48.520345 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba87bef-82bc-4e04-80cc-c8f6274c9a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:48.520635 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba87bef-82bc-4e04-80cc-c8f6274c9a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:48.520912 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba87bef-82bc-4e04-80cc-c8f6274c9a6d admin admin] PATH_INFO: `/v3/projects/061ae6e6d5d948169036bad7e228c59d/users/c5fb378caccb4baf9d663ab22aaa7751/roles/e73a8fc0684c4f6083a71ea9a85c7298` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:48.525251 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 597/1189] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:10:48 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:10:48.525398 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba87bef-82bc-4e04-80cc-c8f6274c9a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=061ae6e6d5d948169036bad7e228c59d, user_id=c5fb378caccb4baf9d663ab22aaa7751, role_id=e73a8fc0684c4f6083a71ea9a85c7298)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:48.527505 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bffe5-e8d2-4158-85eb-82f88ec265c0 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:48.528207 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba87bef-82bc-4e04-80cc-c8f6274c9a6d admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:48.533305 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:48.543054 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bffe5-e8d2-4158-85eb-82f88ec265c0 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:48.545764 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 593/1190] 10.222.0.121 () {60 vars in 1488 bytes} [Fri Aug 26 01:10:48 2022] PUT /identity/v3/projects/061ae6e6d5d948169036bad7e228c59d/users/c5fb378caccb4baf9d663ab22aaa7751/roles/e73a8fc0684c4f6083a71ea9a85c7298 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 01:10:48.662908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7548369-6a62-43cd-812a-91a82f070302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:48.663474 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7548369-6a62-43cd-812a-91a82f070302 admin admin] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:48.663758 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7548369-6a62-43cd-812a-91a82f070302 admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:48.664031 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7548369-6a62-43cd-812a-91a82f070302 admin admin] PATH_INFO: `/v3/projects` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:48.664667 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7548369-6a62-43cd-812a-91a82f070302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:48.666597 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7548369-6a62-43cd-812a-91a82f070302 admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:48.861939 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 598/1191] 10.222.0.121 () {60 vars in 1158 bytes} [Fri Aug 26 01:10:48 2022] POST /identity/v3/projects => generated 376 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 01:10:48.866273 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba87bef-82bc-4e04-80cc-c8f6274c9a6d admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:48.878064 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba87bef-82bc-4e04-80cc-c8f6274c9a6d admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:48.966030 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507548b0-6dd5-4e44-9207-b61258a124e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:48.967111 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507548b0-6dd5-4e44-9207-b61258a124e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:48.967870 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507548b0-6dd5-4e44-9207-b61258a124e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:48.968307 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507548b0-6dd5-4e44-9207-b61258a124e6 admin admin] PATH_INFO: `/v3/users` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:48.971062 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507548b0-6dd5-4e44-9207-b61258a124e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:48.971957 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507548b0-6dd5-4e44-9207-b61258a124e6 admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:49.086304 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 594/1192] 10.222.0.121 () {60 vars in 1149 bytes} [Fri Aug 26 01:10:48 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 01:10:49.091314 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7548369-6a62-43cd-812a-91a82f070302 admin admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:49.107095 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7548369-6a62-43cd-812a-91a82f070302 admin admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:49.112642 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6b799-3f63-4331-a8c4-074ae1e4d497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:49.113527 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6b799-3f63-4331-a8c4-074ae1e4d497 admin admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:49.113814 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6b799-3f63-4331-a8c4-074ae1e4d497 admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:49.114089 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6b799-3f63-4331-a8c4-074ae1e4d497 admin admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:49.114742 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6b799-3f63-4331-a8c4-074ae1e4d497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:49.116550 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6b799-3f63-4331-a8c4-074ae1e4d497 admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:49.130374 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 599/1193] 10.222.0.121 () {58 vars in 1127 bytes} [Fri Aug 26 01:10:49 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 01:10:49.135510 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507548b0-6dd5-4e44-9207-b61258a124e6 admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:49.181009 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507548b0-6dd5-4e44-9207-b61258a124e6 admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:49.188583 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ebf69-e78d-4eda-bd77-6a666ac57d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:49.190413 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ebf69-e78d-4eda-bd77-6a666ac57d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:49.191100 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ebf69-e78d-4eda-bd77-6a666ac57d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:49.191529 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ebf69-e78d-4eda-bd77-6a666ac57d95 admin admin] PATH_INFO: `/v3/projects/7d0664b7459044918cdc1e28a57cb987/users/b6fc6226030343559f1409b80abf379a/roles/e73a8fc0684c4f6083a71ea9a85c7298` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:49.210630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ebf69-e78d-4eda-bd77-6a666ac57d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0664b7459044918cdc1e28a57cb987, user_id=b6fc6226030343559f1409b80abf379a, role_id=e73a8fc0684c4f6083a71ea9a85c7298)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:49.216007 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ebf69-e78d-4eda-bd77-6a666ac57d95 admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:49.340764 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 595/1194] 10.222.0.121 () {60 vars in 1488 bytes} [Fri Aug 26 01:10:49 2022] PUT /identity/v3/projects/7d0664b7459044918cdc1e28a57cb987/users/b6fc6226030343559f1409b80abf379a/roles/e73a8fc0684c4f6083a71ea9a85c7298 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:10:49.345326 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6b799-3f63-4331-a8c4-074ae1e4d497 admin admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:49.360740 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6b799-3f63-4331-a8c4-074ae1e4d497 admin admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:49.447921 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635b38a-ad61-45d1-b04b-4c499110ed15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:49.448572 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b38a-ad61-45d1-b04b-4c499110ed15 admin admin] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:49.448910 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b38a-ad61-45d1-b04b-4c499110ed15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:49.457915 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b38a-ad61-45d1-b04b-4c499110ed15 admin admin] PATH_INFO: `/v3/roles` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:49.457915 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635b38a-ad61-45d1-b04b-4c499110ed15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:49.457915 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635b38a-ad61-45d1-b04b-4c499110ed15 admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:49.465514 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 600/1195] 10.222.0.121 () {58 vars in 1127 bytes} [Fri Aug 26 01:10:49 2022] GET /identity/v3/roles => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 01:10:49.469681 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ebf69-e78d-4eda-bd77-6a666ac57d95 admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:49.483703 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ebf69-e78d-4eda-bd77-6a666ac57d95 admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:49.499804 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b76f2-88fd-4cab-991e-225f6fd2633f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:49.500500 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b76f2-88fd-4cab-991e-225f6fd2633f admin admin] REQUEST_METHOD: `PUT` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:49.501106 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b76f2-88fd-4cab-991e-225f6fd2633f admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:49.501106 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b76f2-88fd-4cab-991e-225f6fd2633f admin admin] PATH_INFO: `/v3/projects/7d0664b7459044918cdc1e28a57cb987/users/b6fc6226030343559f1409b80abf379a/roles/e73a8fc0684c4f6083a71ea9a85c7298` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:49.503058 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b76f2-88fd-4cab-991e-225f6fd2633f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0664b7459044918cdc1e28a57cb987, user_id=b6fc6226030343559f1409b80abf379a, role_id=e73a8fc0684c4f6083a71ea9a85c7298)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:49.506576 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b76f2-88fd-4cab-991e-225f6fd2633f admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:49.527688 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 596/1196] 10.222.0.121 () {60 vars in 1488 bytes} [Fri Aug 26 01:10:49 2022] PUT /identity/v3/projects/7d0664b7459044918cdc1e28a57cb987/users/b6fc6226030343559f1409b80abf379a/roles/e73a8fc0684c4f6083a71ea9a85c7298 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:10:56.358798 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa862b-207f-473b-abfe-da92a26b721f None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:56.359292 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa862b-207f-473b-abfe-da92a26b721f None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:56.359871 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa862b-207f-473b-abfe-da92a26b721f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:56.407547 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-c3fa862b-207f-473b-abfe-da92a26b721f None None] MFA Rules not processed for user `c5fb378caccb4baf9d663ab22aaa7751`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:10:56.411311 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-c3fa862b-207f-473b-abfe-da92a26b721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:10:56.518307 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:56.536087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 601/1197] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:10:56 2022] POST /identity/v3/auth/tokens => generated 2897 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:10:56.550784 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b76f2-88fd-4cab-991e-225f6fd2633f admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:56.553433 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-494b76f2-88fd-4cab-991e-225f6fd2633f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:10:56.628901 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:10:56.681181 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b76f2-88fd-4cab-991e-225f6fd2633f admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:56.689313 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7c47a-6621-4818-a230-7978f73e3667 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe450e040874be58ea27dd47c3ff7a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:56.690420 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c47a-6621-4818-a230-7978f73e3667 service glance] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:56.693447 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c47a-6621-4818-a230-7978f73e3667 service glance] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:56.693447 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7c47a-6621-4818-a230-7978f73e3667 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:56.804180 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7c47a-6621-4818-a230-7978f73e3667 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:56.805765 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7c47a-6621-4818-a230-7978f73e3667 service glance] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:56.828025 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 597/1198] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:10:56 2022] GET /identity/v3/auth/tokens => generated 2830 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:10:57.038932 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb57170-a5b9-42d4-8b92-ad73a5913111 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:57.039606 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb57170-a5b9-42d4-8b92-ad73a5913111 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:57.040789 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb57170-a5b9-42d4-8b92-ad73a5913111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:57.140185 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-ffb57170-a5b9-42d4-8b92-ad73a5913111 None None] MFA Rules not processed for user `b6fc6226030343559f1409b80abf379a`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:10:57.141275 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-ffb57170-a5b9-42d4-8b92-ad73a5913111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:10:57.256687 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 602/1199] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:10:57 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:10:57.267667 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7c47a-6621-4818-a230-7978f73e3667 service glance] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:10:57.288673 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7c47a-6621-4818-a230-7978f73e3667 service glance] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:10:57.305514 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecff93-6a13-4778-a9df-5d7ba1f8b939 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe450e040874be58ea27dd47c3ff7a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:10:57.305936 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecff93-6a13-4778-a9df-5d7ba1f8b939 service glance] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:10:57.306299 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecff93-6a13-4778-a9df-5d7ba1f8b939 service glance] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:10:57.306639 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecff93-6a13-4778-a9df-5d7ba1f8b939 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:10:57.405500 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecff93-6a13-4778-a9df-5d7ba1f8b939 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:10:57.408335 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecff93-6a13-4778-a9df-5d7ba1f8b939 service glance] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:10:57.418345 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 598/1200] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:10:57 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:11:06.632180 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8be0f8-9cd8-4406-9de7-edaffd9cca42 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:06.632793 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8be0f8-9cd8-4406-9de7-edaffd9cca42 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:06.632902 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8be0f8-9cd8-4406-9de7-edaffd9cca42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:06.656498 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-9c8be0f8-9cd8-4406-9de7-edaffd9cca42 None None] MFA Rules not processed for user `dfd67fde6d23497ba4bd2a672069ad30`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:11:06.658048 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-9c8be0f8-9cd8-4406-9de7-edaffd9cca42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:06.665295 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 603/1201] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:11:06 2022] POST /identity/v3/auth/tokens => generated 2830 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:11:07.004720 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92681733-8f58-4086-b938-4e61e4d38f51 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:07.005334 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92681733-8f58-4086-b938-4e61e4d38f51 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:07.005334 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92681733-8f58-4086-b938-4e61e4d38f51 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:07.006679 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 599/1202] 10.222.0.121 () {54 vars in 967 bytes} [Fri Aug 26 01:11:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:11:07.012843 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94713e-230a-4da2-857c-82aad4b8b423 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:07.013348 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94713e-230a-4da2-857c-82aad4b8b423 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:07.013959 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94713e-230a-4da2-857c-82aad4b8b423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:07.036123 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-bf94713e-230a-4da2-857c-82aad4b8b423 None None] MFA Rules not processed for user `9a64697b77c04100934d5bd91cb321ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:11:07.038424 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-bf94713e-230a-4da2-857c-82aad4b8b423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:07.128903 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 604/1203] 10.222.0.121 () {58 vars in 1064 bytes} [Fri Aug 26 01:11:07 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:11:07.134676 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe697dd-f989-4434-a36e-c09dea608678 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:07.135119 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe697dd-f989-4434-a36e-c09dea608678 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:07.135403 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe697dd-f989-4434-a36e-c09dea608678 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:07.137499 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 600/1204] 10.222.0.121 () {54 vars in 917 bytes} [Fri Aug 26 01:11:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:11:07.143297 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6626ada-6ff2-4796-badb-d786a4988b15 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:07.143591 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6626ada-6ff2-4796-badb-d786a4988b15 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:07.143870 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6626ada-6ff2-4796-badb-d786a4988b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:07.168816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-d6626ada-6ff2-4796-badb-d786a4988b15 None None] MFA Rules not processed for user `9a64697b77c04100934d5bd91cb321ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:11:07.168816 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-d6626ada-6ff2-4796-badb-d786a4988b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:07.177656 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 605/1205] 10.222.0.121 () {58 vars in 1014 bytes} [Fri Aug 26 01:11:07 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:11:07.191165 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe697dd-f989-4434-a36e-c09dea608678 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:07.193161 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-2fe697dd-f989-4434-a36e-c09dea608678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:07.207718 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe697dd-f989-4434-a36e-c09dea608678 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:07.211444 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17b79c-be10-4277-a384-c7b0c06d128c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fe450e040874be58ea27dd47c3ff7a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:07.212140 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17b79c-be10-4277-a384-c7b0c06d128c service glance] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:07.212427 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17b79c-be10-4277-a384-c7b0c06d128c service glance] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:07.212702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17b79c-be10-4277-a384-c7b0c06d128c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:07.224016 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17b79c-be10-4277-a384-c7b0c06d128c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:07.226059 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17b79c-be10-4277-a384-c7b0c06d128c service glance] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:07.237175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 601/1206] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:11:07 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:11:07.599996 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff154dc4-f59b-47f2-8cbe-dc21f7490b40 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:07.600441 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff154dc4-f59b-47f2-8cbe-dc21f7490b40 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:07.600726 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff154dc4-f59b-47f2-8cbe-dc21f7490b40 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:07.602177 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 606/1207] 10.222.0.121 () {54 vars in 917 bytes} [Fri Aug 26 01:11:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:11:07.612981 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc18a71-a6fa-4ee3-806b-be6dc3a47a7b None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:07.613275 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc18a71-a6fa-4ee3-806b-be6dc3a47a7b None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:07.613553 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc18a71-a6fa-4ee3-806b-be6dc3a47a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:07.634507 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-9dc18a71-a6fa-4ee3-806b-be6dc3a47a7b None None] MFA Rules not processed for user `8b2d08cc51074be0801fd5df03e3e7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:11:07.635783 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-9dc18a71-a6fa-4ee3-806b-be6dc3a47a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:07.689758 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 602/1208] 10.222.0.121 () {58 vars in 1014 bytes} [Fri Aug 26 01:11:07 2022] POST /identity/v3/auth/tokens => generated 2689 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:11:07.701257 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff154dc4-f59b-47f2-8cbe-dc21f7490b40 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:07.702988 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-ff154dc4-f59b-47f2-8cbe-dc21f7490b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:07.716894 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff154dc4-f59b-47f2-8cbe-dc21f7490b40 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:07.720459 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccde9e-3ed1-474c-beef-8780232a0003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:07.721133 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccde9e-3ed1-474c-beef-8780232a0003 service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:07.721479 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccde9e-3ed1-474c-beef-8780232a0003 service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:07.721827 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccde9e-3ed1-474c-beef-8780232a0003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:07.728950 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccde9e-3ed1-474c-beef-8780232a0003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:07.731010 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccde9e-3ed1-474c-beef-8780232a0003 service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:07.739017 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 607/1209] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:11:07 2022] GET /identity/v3/auth/tokens => generated 2689 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:11:08.293979 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748866c2-a31a-4e5b-ae7d-1e02ffcd978d None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:08.293979 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748866c2-a31a-4e5b-ae7d-1e02ffcd978d None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:08.293979 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748866c2-a31a-4e5b-ae7d-1e02ffcd978d None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:08.293979 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 603/1210] 10.222.0.121 () {54 vars in 967 bytes} [Fri Aug 26 01:11:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:11:08.295654 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6052e-6c3d-475d-bbc6-3b180cd2ae12 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:08.295945 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6052e-6c3d-475d-bbc6-3b180cd2ae12 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:08.296224 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6052e-6c3d-475d-bbc6-3b180cd2ae12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:08.311534 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748866c2-a31a-4e5b-ae7d-1e02ffcd978d None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:08.324428 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-d3c6052e-6c3d-475d-bbc6-3b180cd2ae12 None None] MFA Rules not processed for user `9a64697b77c04100934d5bd91cb321ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:11:08.325655 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-d3c6052e-6c3d-475d-bbc6-3b180cd2ae12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:08.334653 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 608/1211] 10.222.0.121 () {58 vars in 1064 bytes} [Fri Aug 26 01:11:08 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:11:08.336870 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:11:08.340869 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179f9ab-16f3-4407-9bc7-3ac18a796c62 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:08.341188 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179f9ab-16f3-4407-9bc7-3ac18a796c62 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:08.341467 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179f9ab-16f3-4407-9bc7-3ac18a796c62 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:08.343083 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 609/1212] 10.222.0.121 () {54 vars in 917 bytes} [Fri Aug 26 01:11:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 26 01:11:08.348473 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa25a5-2581-44aa-b9a2-d3ac7b3a633b None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:08.350275 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa25a5-2581-44aa-b9a2-d3ac7b3a633b None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:08.350275 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa25a5-2581-44aa-b9a2-d3ac7b3a633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:08.371472 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-7faa25a5-2581-44aa-b9a2-d3ac7b3a633b None None] MFA Rules not processed for user `9a64697b77c04100934d5bd91cb321ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:11:08.372771 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-7faa25a5-2581-44aa-b9a2-d3ac7b3a633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:08.384280 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 610/1213] 10.222.0.121 () {58 vars in 1014 bytes} [Fri Aug 26 01:11:08 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:11:08.396180 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa25a5-2581-44aa-b9a2-d3ac7b3a633b None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:08.405682 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa25a5-2581-44aa-b9a2-d3ac7b3a633b None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:08.409341 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748866c2-a31a-4e5b-ae7d-1e02ffcd978d None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:08.410260 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e343874-7075-4544-895f-a236d94e93f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:08.410895 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e343874-7075-4544-895f-a236d94e93f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:08.411176 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e343874-7075-4544-895f-a236d94e93f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:08.411449 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e343874-7075-4544-895f-a236d94e93f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:08.415467 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a008229-d013-4130-9acd-46480984c0ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49070d8a078644f4a9e17deab052ba41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:08.416417 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a008229-d013-4130-9acd-46480984c0ac service placement] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:08.416802 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a008229-d013-4130-9acd-46480984c0ac service placement] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:08.417141 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a008229-d013-4130-9acd-46480984c0ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:08.419340 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-8a008229-d013-4130-9acd-46480984c0ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:08.422269 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e343874-7075-4544-895f-a236d94e93f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:08.423813 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e343874-7075-4544-895f-a236d94e93f8 service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:08.435130 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a008229-d013-4130-9acd-46480984c0ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:08.436556 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 611/1214] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:11:08 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:11:08.436947 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a008229-d013-4130-9acd-46480984c0ac service placement] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:08.447764 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 604/1215] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:11:08 2022] GET /identity/v3/auth/tokens => generated 2876 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:11:18.430921 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=88 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:11:18.443175 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=24 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:11:25.426167 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908a2f6-00af-4bae-b342-1379d4570c4a None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:25.426845 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908a2f6-00af-4bae-b342-1379d4570c4a None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:25.426845 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908a2f6-00af-4bae-b342-1379d4570c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:25.446419 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-6908a2f6-00af-4bae-b342-1379d4570c4a None None] MFA Rules not processed for user `8b2d08cc51074be0801fd5df03e3e7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:11:25.448155 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-6908a2f6-00af-4bae-b342-1379d4570c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:25.454743 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 612/1216] 10.222.0.123 () {58 vars in 1020 bytes} [Fri Aug 26 01:11:25 2022] POST /identity/v3/auth/tokens => generated 2689 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:11:25.473152 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a008229-d013-4130-9acd-46480984c0ac service placement] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:25.491048 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a008229-d013-4130-9acd-46480984c0ac service placement] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:25.496469 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8d5b4-ef82-4e92-bbd7-8c43f51432eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:25.497190 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8d5b4-ef82-4e92-bbd7-8c43f51432eb service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:25.497568 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8d5b4-ef82-4e92-bbd7-8c43f51432eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:25.497936 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8d5b4-ef82-4e92-bbd7-8c43f51432eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:25.512821 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8d5b4-ef82-4e92-bbd7-8c43f51432eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:25.514279 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8d5b4-ef82-4e92-bbd7-8c43f51432eb service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:25.522303 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 605/1217] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:11:25 2022] GET /identity/v3/auth/tokens => generated 2689 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:11:26.427127 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddadaa3-c420-4ca2-8a11-845924647427 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:26.427778 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddadaa3-c420-4ca2-8a11-845924647427 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:26.427778 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddadaa3-c420-4ca2-8a11-845924647427 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:26.429007 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 613/1218] 10.222.0.121 () {54 vars in 926 bytes} [Fri Aug 26 01:11:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:11:26.436847 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92ac6d-c95a-48f3-af02-4dd782117642 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:26.437945 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92ac6d-c95a-48f3-af02-4dd782117642 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:26.438735 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92ac6d-c95a-48f3-af02-4dd782117642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:26.460358 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-7f92ac6d-c95a-48f3-af02-4dd782117642 None None] MFA Rules not processed for user `9a64697b77c04100934d5bd91cb321ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:11:26.461613 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-7f92ac6d-c95a-48f3-af02-4dd782117642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:26.471287 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 606/1219] 10.222.0.121 () {58 vars in 1023 bytes} [Fri Aug 26 01:11:26 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 01:11:26.485113 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddadaa3-c420-4ca2-8a11-845924647427 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:26.499106 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddadaa3-c420-4ca2-8a11-845924647427 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:26.504132 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654d1e3-aac3-413c-b683-2b4712ce8839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:26.504724 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654d1e3-aac3-413c-b683-2b4712ce8839 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:26.505003 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654d1e3-aac3-413c-b683-2b4712ce8839 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:26.505281 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654d1e3-aac3-413c-b683-2b4712ce8839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:26.514325 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654d1e3-aac3-413c-b683-2b4712ce8839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:26.515945 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654d1e3-aac3-413c-b683-2b4712ce8839 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:26.526402 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 614/1220] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:11:26 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:11:35.368630 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4520f-5dea-41b5-a2b0-04a910da7586 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:35.369211 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4520f-5dea-41b5-a2b0-04a910da7586 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:35.369211 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4520f-5dea-41b5-a2b0-04a910da7586 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:35.370725 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 607/1221] 10.222.0.121 () {54 vars in 926 bytes} [Fri Aug 26 01:11:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:11:35.378517 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6dd1a-4a97-4640-ab85-3bdc8f02f6ae None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:35.379087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6dd1a-4a97-4640-ab85-3bdc8f02f6ae None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:35.379087 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6dd1a-4a97-4640-ab85-3bdc8f02f6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:35.402152 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-31b6dd1a-4a97-4640-ab85-3bdc8f02f6ae None None] MFA Rules not processed for user `9a64697b77c04100934d5bd91cb321ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:11:35.403218 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-31b6dd1a-4a97-4640-ab85-3bdc8f02f6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:11:35.414252 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 615/1222] 10.222.0.121 () {58 vars in 1023 bytes} [Fri Aug 26 01:11:35 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:11:35.429874 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4520f-5dea-41b5-a2b0-04a910da7586 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:11:35.452482 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4520f-5dea-41b5-a2b0-04a910da7586 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:11:35.460740 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9db68-6b2b-444b-8908-acf37065f8b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:11:35.461750 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9db68-6b2b-444b-8908-acf37065f8b8 service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:11:35.462242 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9db68-6b2b-444b-8908-acf37065f8b8 service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:11:35.462589 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9db68-6b2b-444b-8908-acf37065f8b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:11:35.477543 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9db68-6b2b-444b-8908-acf37065f8b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:11:35.481364 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9db68-6b2b-444b-8908-acf37065f8b8 service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:11:35.490782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 608/1223] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:11:35 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:11:45.396230 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=12 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:11:45.486434 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=15 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:12:01.564750 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6dd1a-4a97-4640-ab85-3bdc8f02f6ae None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:12:01.577653 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6dd1a-4a97-4640-ab85-3bdc8f02f6ae None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:12:01.582648 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24907a-01b0-416e-adbb-631370db1b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:12:01.585018 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24907a-01b0-416e-adbb-631370db1b3a service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:12:01.585018 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24907a-01b0-416e-adbb-631370db1b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:12:01.585018 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24907a-01b0-416e-adbb-631370db1b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:12:01.594339 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24907a-01b0-416e-adbb-631370db1b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:12:01.595809 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24907a-01b0-416e-adbb-631370db1b3a service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:12:01.605196 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 616/1224] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:12:01 2022] GET /identity/v3/auth/tokens => generated 2897 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:12:08.183457 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab91d71-cba8-4673-9f4a-56f9edbc01af None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:12:08.185298 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab91d71-cba8-4673-9f4a-56f9edbc01af None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:12:08.185767 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab91d71-cba8-4673-9f4a-56f9edbc01af None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:12:08.187501 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 609/1225] 10.222.0.121 () {54 vars in 926 bytes} [Fri Aug 26 01:12:08 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:12:08.216587 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c57a0-0e04-4fb8-872c-42c66ea31cb4 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:12:08.217132 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c57a0-0e04-4fb8-872c-42c66ea31cb4 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:12:08.217132 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c57a0-0e04-4fb8-872c-42c66ea31cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:12:08.238866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-480c57a0-0e04-4fb8-872c-42c66ea31cb4 None None] MFA Rules not processed for user `9a64697b77c04100934d5bd91cb321ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:12:08.240699 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-480c57a0-0e04-4fb8-872c-42c66ea31cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:12:08.250291 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 617/1226] 10.222.0.121 () {58 vars in 1023 bytes} [Fri Aug 26 01:12:08 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:12:08.277243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab91d71-cba8-4673-9f4a-56f9edbc01af None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:12:08.293442 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab91d71-cba8-4673-9f4a-56f9edbc01af None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:12:08.300706 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c340a67-8b38-43c2-9b34-51d65467f9e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:12:08.301330 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c340a67-8b38-43c2-9b34-51d65467f9e0 service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:12:08.301609 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c340a67-8b38-43c2-9b34-51d65467f9e0 service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:12:08.302035 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c340a67-8b38-43c2-9b34-51d65467f9e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:12:08.317889 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c340a67-8b38-43c2-9b34-51d65467f9e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:12:08.319860 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c340a67-8b38-43c2-9b34-51d65467f9e0 service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:12:08.335064 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 610/1227] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:12:08 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:12:18.231620 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=9 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:12:18.327072 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=6 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:13:04.320385 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6676dfa-80e1-4cc5-b1b5-da9bf6937910 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:13:04.320876 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6676dfa-80e1-4cc5-b1b5-da9bf6937910 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:13:04.320963 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6676dfa-80e1-4cc5-b1b5-da9bf6937910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:13:04.348567 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-f6676dfa-80e1-4cc5-b1b5-da9bf6937910 None None] MFA Rules not processed for user `b57c5c79071a42e8b98599cea4190eee`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:13:04.349752 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-f6676dfa-80e1-4cc5-b1b5-da9bf6937910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:13:04.376731 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 618/1228] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:13:04 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:13:04.695561 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb6c78-27d2-4ae5-8794-8df1fa68c3e0 None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:13:04.696062 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb6c78-27d2-4ae5-8794-8df1fa68c3e0 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:13:04.696185 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb6c78-27d2-4ae5-8794-8df1fa68c3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:13:04.763390 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-d5bb6c78-27d2-4ae5-8794-8df1fa68c3e0 None None] MFA Rules not processed for user `8b2d08cc51074be0801fd5df03e3e7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:13:04.764677 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-d5bb6c78-27d2-4ae5-8794-8df1fa68c3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:13:04.796143 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 611/1229] 10.222.0.121 () {58 vars in 1014 bytes} [Fri Aug 26 01:13:04 2022] POST /identity/v3/auth/tokens => generated 2689 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:13:04.807892 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6676dfa-80e1-4cc5-b1b5-da9bf6937910 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:13:04.817421 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6676dfa-80e1-4cc5-b1b5-da9bf6937910 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:13:04.821037 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555bf40-fdac-486c-aa85-1a00ed4fba95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:13:04.821640 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555bf40-fdac-486c-aa85-1a00ed4fba95 service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:13:04.821920 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555bf40-fdac-486c-aa85-1a00ed4fba95 service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:13:04.822193 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555bf40-fdac-486c-aa85-1a00ed4fba95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:13:04.829850 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555bf40-fdac-486c-aa85-1a00ed4fba95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:13:04.831375 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555bf40-fdac-486c-aa85-1a00ed4fba95 service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:13:04.839005 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 619/1230] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:13:04 2022] GET /identity/v3/auth/tokens => generated 2689 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 01:13:14.793296 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=33 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:13:14.836171 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=21 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:13:46.714230 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52852141-39af-41ce-86ab-b5611c561f7f None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:13:46.715495 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52852141-39af-41ce-86ab-b5611c561f7f None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:13:46.715495 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52852141-39af-41ce-86ab-b5611c561f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:13:46.734038 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-52852141-39af-41ce-86ab-b5611c561f7f None None] MFA Rules not processed for user `b57c5c79071a42e8b98599cea4190eee`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:13:46.735273 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-52852141-39af-41ce-86ab-b5611c561f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:13:46.742821 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 612/1231] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:13:46 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:13:56.728818 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=3 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:14:09.343644 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c52adb-9579-4369-91bc-193f5e47a985 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:14:09.344143 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c52adb-9579-4369-91bc-193f5e47a985 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:14:09.344249 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c52adb-9579-4369-91bc-193f5e47a985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:14:09.363119 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-30c52adb-9579-4369-91bc-193f5e47a985 None None] MFA Rules not processed for user `b57c5c79071a42e8b98599cea4190eee`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:14:09.364325 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-30c52adb-9579-4369-91bc-193f5e47a985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:14:09.371677 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 620/1232] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:14:09 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:14:11.281493 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3136fe-e0f3-4538-9974-d04a97f54e36 None None] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:14:11.281893 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3136fe-e0f3-4538-9974-d04a97f54e36 None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:14:11.282028 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3136fe-e0f3-4538-9974-d04a97f54e36 None None] PATH_INFO: `/` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:14:11.283447 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 613/1233] 10.222.0.121 () {54 vars in 966 bytes} [Fri Aug 26 01:14:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:14:11.288711 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50b263-e475-40d0-ad0c-2fdec16fa004 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:14:11.289107 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50b263-e475-40d0-ad0c-2fdec16fa004 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:14:11.289267 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50b263-e475-40d0-ad0c-2fdec16fa004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:14:11.339086 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-cf50b263-e475-40d0-ad0c-2fdec16fa004 None None] MFA Rules not processed for user `49070d8a078644f4a9e17deab052ba41`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:14:11.340303 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-cf50b263-e475-40d0-ad0c-2fdec16fa004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:14:11.365075 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 621/1234] 10.222.0.121 () {58 vars in 1063 bytes} [Fri Aug 26 01:14:11 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:14:11.373368 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3136fe-e0f3-4538-9974-d04a97f54e36 None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:14:11.387082 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3136fe-e0f3-4538-9974-d04a97f54e36 None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:14:11.391927 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c980e-89fb-495f-9529-f28c85656c1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49070d8a078644f4a9e17deab052ba41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:14:11.392508 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c980e-89fb-495f-9529-f28c85656c1c service placement] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:14:11.392782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c980e-89fb-495f-9529-f28c85656c1c service placement] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:14:11.393048 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c980e-89fb-495f-9529-f28c85656c1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:14:11.401035 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c980e-89fb-495f-9529-f28c85656c1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:14:11.402613 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c980e-89fb-495f-9529-f28c85656c1c service placement] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:14:11.412427 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 614/1235] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:14:11 2022] GET /identity/v3/auth/tokens => generated 2876 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:14:21.362142 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=24 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:14:21.408135 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=6 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:15:34.515593 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5f36d-84b9-45a6-9a33-2cc77105984f None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:15:34.516654 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5f36d-84b9-45a6-9a33-2cc77105984f None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:15:34.516654 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5f36d-84b9-45a6-9a33-2cc77105984f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:15:34.535168 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-68a5f36d-84b9-45a6-9a33-2cc77105984f None None] MFA Rules not processed for user `b57c5c79071a42e8b98599cea4190eee`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:15:34.536370 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-68a5f36d-84b9-45a6-9a33-2cc77105984f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:15:34.543458 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 622/1236] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:15:34 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:15:44.529764 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=3 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:15:52.373244 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c980e-89fb-495f-9529-f28c85656c1c service placement] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:15:52.382954 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c980e-89fb-495f-9529-f28c85656c1c service placement] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:15:52.386446 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3d50c-ed9f-46f3-8fcb-3505f6b469f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:15:52.387072 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3d50c-ed9f-46f3-8fcb-3505f6b469f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:15:52.387351 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3d50c-ed9f-46f3-8fcb-3505f6b469f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:15:52.387627 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3d50c-ed9f-46f3-8fcb-3505f6b469f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:15:52.397197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3d50c-ed9f-46f3-8fcb-3505f6b469f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:15:52.398623 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3d50c-ed9f-46f3-8fcb-3505f6b469f2 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:15:52.408242 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 615/1237] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:15:52 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:16:02.403923 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=6 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:16:54.728349 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5f36d-84b9-45a6-9a33-2cc77105984f None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:16:54.738756 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5f36d-84b9-45a6-9a33-2cc77105984f None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:16:54.742305 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7057a2-0e0b-43b9-ab56-e317a4333a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:16:54.742969 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7057a2-0e0b-43b9-ab56-e317a4333a21 service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:16:54.743251 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7057a2-0e0b-43b9-ab56-e317a4333a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:16:54.743521 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7057a2-0e0b-43b9-ab56-e317a4333a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:16:54.750632 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7057a2-0e0b-43b9-ab56-e317a4333a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:16:54.752097 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7057a2-0e0b-43b9-ab56-e317a4333a21 service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:16:54.759882 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 623/1238] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:16:54 2022] GET /identity/v3/auth/tokens => generated 2689 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:17:04.756511 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=6 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:17:18.568871 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3d50c-ed9f-46f3-8fcb-3505f6b469f2 service neutron] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:18.589678 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3d50c-ed9f-46f3-8fcb-3505f6b469f2 service neutron] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:18.594644 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c083b21-2eee-4bc5-b8a9-7cf64d221cae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:18.595269 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c083b21-2eee-4bc5-b8a9-7cf64d221cae service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:18.595552 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c083b21-2eee-4bc5-b8a9-7cf64d221cae service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:18.595831 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c083b21-2eee-4bc5-b8a9-7cf64d221cae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:18.603453 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c083b21-2eee-4bc5-b8a9-7cf64d221cae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:18.605034 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c083b21-2eee-4bc5-b8a9-7cf64d221cae service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:18.613836 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 616/1239] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:17:18 2022] GET /identity/v3/auth/tokens => generated 2830 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:17:18.663122 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7057a2-0e0b-43b9-ab56-e317a4333a21 service neutron] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:18.671919 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7057a2-0e0b-43b9-ab56-e317a4333a21 service neutron] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:18.675501 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca22f4e-b17f-42da-83f6-cb911ea15fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:18.676092 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca22f4e-b17f-42da-83f6-cb911ea15fbd service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:18.676373 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca22f4e-b17f-42da-83f6-cb911ea15fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:18.676645 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca22f4e-b17f-42da-83f6-cb911ea15fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:18.685888 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca22f4e-b17f-42da-83f6-cb911ea15fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:18.687352 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca22f4e-b17f-42da-83f6-cb911ea15fbd service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:18.698014 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 624/1240] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:17:18 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:17:19.167074 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c083b21-2eee-4bc5-b8a9-7cf64d221cae service nova] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:19.185953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c083b21-2eee-4bc5-b8a9-7cf64d221cae service nova] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:19.195626 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e8183-8fe9-481a-872f-446d34b5043f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:19.196631 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e8183-8fe9-481a-872f-446d34b5043f service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:19.197128 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e8183-8fe9-481a-872f-446d34b5043f service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:19.197607 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e8183-8fe9-481a-872f-446d34b5043f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:19.211502 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e8183-8fe9-481a-872f-446d34b5043f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:19.219185 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e8183-8fe9-481a-872f-446d34b5043f service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:19.231595 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 617/1241] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:17:19 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:17:20.609383 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca22f4e-b17f-42da-83f6-cb911ea15fbd service neutron] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:20.625184 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca22f4e-b17f-42da-83f6-cb911ea15fbd service neutron] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:20.630615 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf05de2-d2c3-407b-83b0-4fe2c7cbbb44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:20.631494 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf05de2-d2c3-407b-83b0-4fe2c7cbbb44 service nova] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:20.631779 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf05de2-d2c3-407b-83b0-4fe2c7cbbb44 service nova] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:20.632049 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf05de2-d2c3-407b-83b0-4fe2c7cbbb44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:20.642002 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf05de2-d2c3-407b-83b0-4fe2c7cbbb44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:20.647436 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf05de2-d2c3-407b-83b0-4fe2c7cbbb44 service nova] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:20.661491 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 625/1242] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:17:20 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:17:20.748637 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e8183-8fe9-481a-872f-446d34b5043f service nova] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:20.820277 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e8183-8fe9-481a-872f-446d34b5043f service nova] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:20.824045 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40523bd-db07-4449-ad80-4350295815f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b48c6b8ef7284907bbfd5b48e2b58516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:20.824653 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40523bd-db07-4449-ad80-4350295815f3 service cinder] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:20.824931 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40523bd-db07-4449-ad80-4350295815f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:20.825200 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40523bd-db07-4449-ad80-4350295815f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:20.836053 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40523bd-db07-4449-ad80-4350295815f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:20.837953 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40523bd-db07-4449-ad80-4350295815f3 service cinder] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:20.851159 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 618/1243] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:17:20 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:17:30.655317 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=12 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:17:30.844827 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=46 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:17:45.918964 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d3092-cb8b-4271-973a-420b0e6faa61 None None] REQUEST_METHOD: `POST` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:45.919521 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d3092-cb8b-4271-973a-420b0e6faa61 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:45.919521 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d3092-cb8b-4271-973a-420b0e6faa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:45.938548 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.auth.core [None req-385d3092-cb8b-4271-973a-420b0e6faa61 None None] MFA Rules not processed for user `dfd67fde6d23497ba4bd2a672069ad30`. Rule list: `[]` (Enabled: `True`). {{(pid=88531) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:17:45.939769 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-385d3092-cb8b-4271-973a-420b0e6faa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:17:45.947682 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 626/1244] 10.222.0.121 () {58 vars in 963 bytes} [Fri Aug 26 01:17:45 2022] POST /identity/v3/auth/tokens => generated 2830 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:17:46.204764 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40523bd-db07-4449-ad80-4350295815f3 service cinder] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:46.214188 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40523bd-db07-4449-ad80-4350295815f3 service cinder] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:46.217717 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8d6d1-314d-4e24-810f-d96df824a483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:46.218311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8d6d1-314d-4e24-810f-d96df824a483 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:46.218590 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8d6d1-314d-4e24-810f-d96df824a483 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:46.218899 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8d6d1-314d-4e24-810f-d96df824a483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:46.226511 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8d6d1-314d-4e24-810f-d96df824a483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:46.230928 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8d6d1-314d-4e24-810f-d96df824a483 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:46.236237 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 619/1245] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:17:46 2022] GET /identity/v3/auth/tokens => generated 2689 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:17:46.672667 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d3092-cb8b-4271-973a-420b0e6faa61 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:17:46.685459 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d3092-cb8b-4271-973a-420b0e6faa61 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:17:46.690598 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c453917-9664-4c30-9121-47c5e67cf517 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49070d8a078644f4a9e17deab052ba41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:17:46.691309 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c453917-9664-4c30-9121-47c5e67cf517 service placement] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:17:46.691651 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c453917-9664-4c30-9121-47c5e67cf517 service placement] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:17:46.691984 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c453917-9664-4c30-9121-47c5e67cf517 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:17:46.701607 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c453917-9664-4c30-9121-47c5e67cf517 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:17:46.703284 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c453917-9664-4c30-9121-47c5e67cf517 service placement] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:17:46.712842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 627/1246] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:17:46 2022] GET /identity/v3/auth/tokens => generated 2876 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:17:56.232769 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=6 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:17:56.708862 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=9 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:18:11.581009 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8d6d1-314d-4e24-810f-d96df824a483 service neutron] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:18:11.593663 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8d6d1-314d-4e24-810f-d96df824a483 service neutron] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:18:11.598843 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5e2db-6873-416f-b92d-38bd2ffce7d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:18:11.599462 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5e2db-6873-416f-b92d-38bd2ffce7d9 service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:18:11.599738 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5e2db-6873-416f-b92d-38bd2ffce7d9 service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:18:11.600008 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5e2db-6873-416f-b92d-38bd2ffce7d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:18:11.609092 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5e2db-6873-416f-b92d-38bd2ffce7d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:18:11.610680 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5e2db-6873-416f-b92d-38bd2ffce7d9 service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:18:11.620672 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 620/1247] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:18:11 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:18:21.616692 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=6 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:18:24.729724 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c453917-9664-4c30-9121-47c5e67cf517 service placement] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:18:24.740519 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c453917-9664-4c30-9121-47c5e67cf517 service placement] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:18:24.744069 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc7bf6-3e2f-4b1c-99ae-0310688a6004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:18:24.744666 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc7bf6-3e2f-4b1c-99ae-0310688a6004 service neutron] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:18:24.744940 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc7bf6-3e2f-4b1c-99ae-0310688a6004 service neutron] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:18:24.745216 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc7bf6-3e2f-4b1c-99ae-0310688a6004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:18:24.754935 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc7bf6-3e2f-4b1c-99ae-0310688a6004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:18:24.756363 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc7bf6-3e2f-4b1c-99ae-0310688a6004 service neutron] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:18:24.765851 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 628/1248] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:18:24 2022] GET /identity/v3/auth/tokens => generated 2897 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:18:34.761585 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=6 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:19:15.424201 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5e2db-6873-416f-b92d-38bd2ffce7d9 service nova] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:19:15.434573 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5e2db-6873-416f-b92d-38bd2ffce7d9 service nova] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:19:15.440163 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5740e-4321-4b84-9b80-3c5237d58769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a64697b77c04100934d5bd91cb321ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:19:15.440741 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5740e-4321-4b84-9b80-3c5237d58769 service nova] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:19:15.441017 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5740e-4321-4b84-9b80-3c5237d58769 service nova] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:19:15.441337 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5740e-4321-4b84-9b80-3c5237d58769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:19:15.449072 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5740e-4321-4b84-9b80-3c5237d58769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:19:15.458277 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5740e-4321-4b84-9b80-3c5237d58769 service nova] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:19:15.460201 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 621/1249] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:19:15 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:19:20.895200 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc7bf6-3e2f-4b1c-99ae-0310688a6004 service neutron] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:19:20.907318 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc7bf6-3e2f-4b1c-99ae-0310688a6004 service neutron] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:19:20.912413 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9ea3b-409e-4732-b64b-1bd79a2dc832 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49070d8a078644f4a9e17deab052ba41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:19:20.913047 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ea3b-409e-4732-b64b-1bd79a2dc832 service placement] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:19:20.913331 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ea3b-409e-4732-b64b-1bd79a2dc832 service placement] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:19:20.913607 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ea3b-409e-4732-b64b-1bd79a2dc832 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:19:20.915442 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-fdf9ea3b-409e-4732-b64b-1bd79a2dc832 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:19:20.926992 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9ea3b-409e-4732-b64b-1bd79a2dc832 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:19:20.928569 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9ea3b-409e-4732-b64b-1bd79a2dc832 service placement] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:19:20.938099 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 629/1250] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:19:20 2022] GET /identity/v3/auth/tokens => generated 2876 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:19:25.456225 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=6 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:19:30.844909 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5740e-4321-4b84-9b80-3c5237d58769 service nova] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:19:30.846605 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-b8f5740e-4321-4b84-9b80-3c5237d58769 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:19:30.858401 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5740e-4321-4b84-9b80-3c5237d58769 service nova] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:19:30.862021 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b83309-ab35-405d-b814-9a494a8370c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:19:30.862621 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b83309-ab35-405d-b814-9a494a8370c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:19:30.862945 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b83309-ab35-405d-b814-9a494a8370c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:19:30.863220 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b83309-ab35-405d-b814-9a494a8370c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:19:30.934131 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=6 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:19:30.936796 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b83309-ab35-405d-b814-9a494a8370c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:19:30.938248 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b83309-ab35-405d-b814-9a494a8370c7 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:19:30.966577 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 622/1251] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:19:30 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:19:34.692321 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9183a3-ded9-4db6-8e74-cd003f5e5456 None None] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:19:34.692834 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9183a3-ded9-4db6-8e74-cd003f5e5456 None None] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:19:34.693011 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9183a3-ded9-4db6-8e74-cd003f5e5456 None None] PATH_INFO: `/` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:19:34.694412 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 630/1252] 10.222.0.121 () {54 vars in 926 bytes} [Fri Aug 26 01:19:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 26 01:19:34.935259 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a57e7-3cd7-415e-9fe9-fd61f877416d None None] REQUEST_METHOD: `POST` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:19:34.935783 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a57e7-3cd7-415e-9fe9-fd61f877416d None None] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:19:34.935783 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a57e7-3cd7-415e-9fe9-fd61f877416d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:19:34.959217 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.auth.core [None req-a73a57e7-3cd7-415e-9fe9-fd61f877416d None None] MFA Rules not processed for user `49070d8a078644f4a9e17deab052ba41`. Rule list: `[]` (Enabled: `True`). {{(pid=88530) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 01:19:34.959217 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-a73a57e7-3cd7-415e-9fe9-fd61f877416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:19:34.967879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 623/1253] 10.222.0.121 () {58 vars in 1023 bytes} [Fri Aug 26 01:19:34 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 01:19:34.979539 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9183a3-ded9-4db6-8e74-cd003f5e5456 None None] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:19:34.993108 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9183a3-ded9-4db6-8e74-cd003f5e5456 None None] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:19:34.998201 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4602e-6401-49cf-a55b-700b3975e9d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49070d8a078644f4a9e17deab052ba41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:19:34.999057 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4602e-6401-49cf-a55b-700b3975e9d5 service placement] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:19:34.999386 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4602e-6401-49cf-a55b-700b3975e9d5 service placement] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:19:34.999847 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4602e-6401-49cf-a55b-700b3975e9d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:19:35.009256 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4602e-6401-49cf-a55b-700b3975e9d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:19:35.010908 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4602e-6401-49cf-a55b-700b3975e9d5 service placement] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:19:35.021429 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 631/1254] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:19:34 2022] GET /identity/v3/auth/tokens => generated 2876 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:19:38.596227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a57e7-3cd7-415e-9fe9-fd61f877416d None None] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:19:38.608243 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a57e7-3cd7-415e-9fe9-fd61f877416d None None] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:19:38.613557 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3cda3-815a-4f15-ab30-30c04024cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:19:38.614201 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3cda3-815a-4f15-ab30-30c04024cead admin admin] REQUEST_METHOD: `DELETE` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:19:38.614479 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3cda3-815a-4f15-ab30-30c04024cead admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:19:38.614799 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3cda3-815a-4f15-ab30-30c04024cead admin admin] PATH_INFO: `/v3/users/b57c5c79071a42e8b98599cea4190eee` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:19:38.615977 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3cda3-815a-4f15-ab30-30c04024cead admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57c5c79071a42e8b98599cea4190eee)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:19:38.617034 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: WARNING py.warnings [None req-61c3cda3-815a-4f15-ab30-30c04024cead admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:19:38.617034 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: warnings.warn(msg) Aug 26 01:19:38.617034 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: Aug 26 01:19:38.618284 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3cda3-815a-4f15-ab30-30c04024cead admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:19:38.825279 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-61c3cda3-815a-4f15-ab30-30c04024cead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57c5c79071a42e8b98599cea4190eee'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:38.894182 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-61c3cda3-815a-4f15-ab30-30c04024cead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57c5c79071a42e8b98599cea4190eee'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:38.894798 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-61c3cda3-815a-4f15-ab30-30c04024cead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57c5c79071a42e8b98599cea4190eee'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:38.913995 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-61c3cda3-815a-4f15-ab30-30c04024cead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57c5c79071a42e8b98599cea4190eee'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:38.926335 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-61c3cda3-815a-4f15-ab30-30c04024cead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57c5c79071a42e8b98599cea4190eee'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:38.932227 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 624/1255] 10.222.0.121 () {58 vars in 1229 bytes} [Fri Aug 26 01:19:38 2022] DELETE /identity/v3/users/b57c5c79071a42e8b98599cea4190eee => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:19:39.182236 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4602e-6401-49cf-a55b-700b3975e9d5 service placement] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:19:39.197180 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4602e-6401-49cf-a55b-700b3975e9d5 service placement] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:19:39.248609 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:19:39.249231 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:19:39.249508 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:19:39.249776 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] PATH_INFO: `/v3/projects/8f52bc1031a449258046cb689e90e74e` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:19:39.250906 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f52bc1031a449258046cb689e90e74e)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:19:39.251937 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: WARNING py.warnings [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 01:19:39.251937 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: warnings.warn(msg) Aug 26 01:19:39.251937 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: Aug 26 01:19:39.253141 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:19:39.373866 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f52bc1031a449258046cb689e90e74e', 'request_id': 'req-d1fafe29-bf42-4504-847b-78e7d152f8c4'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:39.379876 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f52bc1031a449258046cb689e90e74e', 'request_id': 'req-d1fafe29-bf42-4504-847b-78e7d152f8c4'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:39.393420 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f52bc1031a449258046cb689e90e74e', 'request_id': 'req-d1fafe29-bf42-4504-847b-78e7d152f8c4'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:39.507884 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] The token cache is being invalidate because project 8f52bc1031a449258046cb689e90e74e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 01:19:39.508175 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:39.508792 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:39.510263 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 632/1256] 10.222.0.121 () {58 vars in 1238 bytes} [Fri Aug 26 01:19:39 2022] DELETE /identity/v3/projects/8f52bc1031a449258046cb689e90e74e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:19:39.514311 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3cda3-815a-4f15-ab30-30c04024cead admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:19:39.515787 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-61c3cda3-815a-4f15-ab30-30c04024cead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:19:39.529223 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3cda3-815a-4f15-ab30-30c04024cead admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:19:39.569464 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:19:39.585840 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44babf23-803a-413a-a27d-26586154588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:19:39.586498 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44babf23-803a-413a-a27d-26586154588f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:19:39.586778 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44babf23-803a-413a-a27d-26586154588f admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:19:39.587101 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44babf23-803a-413a-a27d-26586154588f admin admin] PATH_INFO: `/v3/users/b6fc6226030343559f1409b80abf379a` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:19:39.588240 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44babf23-803a-413a-a27d-26586154588f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6fc6226030343559f1409b80abf379a)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:19:39.590199 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44babf23-803a-413a-a27d-26586154588f admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:19:39.806987 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-44babf23-803a-413a-a27d-26586154588f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6fc6226030343559f1409b80abf379a'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:39.867197 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-44babf23-803a-413a-a27d-26586154588f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6fc6226030343559f1409b80abf379a'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:39.867816 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-44babf23-803a-413a-a27d-26586154588f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6fc6226030343559f1409b80abf379a'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:39.880680 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-44babf23-803a-413a-a27d-26586154588f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6fc6226030343559f1409b80abf379a'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:39.887692 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-44babf23-803a-413a-a27d-26586154588f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6fc6226030343559f1409b80abf379a'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:39.894328 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 625/1257] 10.222.0.121 () {58 vars in 1229 bytes} [Fri Aug 26 01:19:39 2022] DELETE /identity/v3/users/b6fc6226030343559f1409b80abf379a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:19:40.149225 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:19:40.149225 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:19:40.164604 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fafe29-bf42-4504-847b-78e7d152f8c4 admin admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:19:40.222046 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300e136-33df-4ea9-89a6-419e32d8addc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:19:40.222663 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300e136-33df-4ea9-89a6-419e32d8addc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:19:40.222974 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300e136-33df-4ea9-89a6-419e32d8addc admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:19:40.223249 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300e136-33df-4ea9-89a6-419e32d8addc admin admin] PATH_INFO: `/v3/projects/7d0664b7459044918cdc1e28a57cb987` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:19:40.224335 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300e136-33df-4ea9-89a6-419e32d8addc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0664b7459044918cdc1e28a57cb987)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:19:40.226246 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300e136-33df-4ea9-89a6-419e32d8addc admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:19:40.234333 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:19:40.339769 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-c300e136-33df-4ea9-89a6-419e32d8addc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0664b7459044918cdc1e28a57cb987', 'request_id': 'req-c300e136-33df-4ea9-89a6-419e32d8addc'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:40.345427 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-c300e136-33df-4ea9-89a6-419e32d8addc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0664b7459044918cdc1e28a57cb987', 'request_id': 'req-c300e136-33df-4ea9-89a6-419e32d8addc'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:40.351447 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-c300e136-33df-4ea9-89a6-419e32d8addc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0664b7459044918cdc1e28a57cb987', 'request_id': 'req-c300e136-33df-4ea9-89a6-419e32d8addc'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:40.427601 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-c300e136-33df-4ea9-89a6-419e32d8addc admin admin] The token cache is being invalidate because project 7d0664b7459044918cdc1e28a57cb987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88531) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 01:19:40.427821 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-c300e136-33df-4ea9-89a6-419e32d8addc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:40.428508 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-c300e136-33df-4ea9-89a6-419e32d8addc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:19:40.430156 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 633/1258] 10.222.0.121 () {58 vars in 1238 bytes} [Fri Aug 26 01:19:40 2022] DELETE /identity/v3/projects/7d0664b7459044918cdc1e28a57cb987 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:19:49.890095 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=34,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:19:50.455017 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:21:22.056968 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44babf23-803a-413a-a27d-26586154588f admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:21:22.058405 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-44babf23-803a-413a-a27d-26586154588f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:21:22.116083 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44babf23-803a-413a-a27d-26586154588f admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:21:22.163879 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614b611-9bea-49c3-9ba8-4e88186fd793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2d08cc51074be0801fd5df03e3e7b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:21:22.164483 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614b611-9bea-49c3-9ba8-4e88186fd793 service neutron] REQUEST_METHOD: `GET` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:21:22.164764 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614b611-9bea-49c3-9ba8-4e88186fd793 service neutron] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:21:22.165037 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614b611-9bea-49c3-9ba8-4e88186fd793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:21:22.166782 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-b614b611-9bea-49c3-9ba8-4e88186fd793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:21:22.230111 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614b611-9bea-49c3-9ba8-4e88186fd793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:21:22.231591 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614b611-9bea-49c3-9ba8-4e88186fd793 service neutron] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:21:22.240903 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 626/1259] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:21:22 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:21:29.817330 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300e136-33df-4ea9-89a6-419e32d8addc admin admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:21:29.818842 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-c300e136-33df-4ea9-89a6-419e32d8addc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:21:29.832423 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300e136-33df-4ea9-89a6-419e32d8addc admin admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:21:29.836917 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2eecd-d4c6-499d-a4b3-4444ad047315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:21:29.837543 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2eecd-d4c6-499d-a4b3-4444ad047315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:21:29.838129 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2eecd-d4c6-499d-a4b3-4444ad047315 admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:21:29.838350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2eecd-d4c6-499d-a4b3-4444ad047315 admin admin] PATH_INFO: `/v3/users/dfd67fde6d23497ba4bd2a672069ad30` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:21:29.852933 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2eecd-d4c6-499d-a4b3-4444ad047315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfd67fde6d23497ba4bd2a672069ad30)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:21:29.854900 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2eecd-d4c6-499d-a4b3-4444ad047315 admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:21:30.046659 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-c9a2eecd-d4c6-499d-a4b3-4444ad047315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfd67fde6d23497ba4bd2a672069ad30'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:30.058504 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-c9a2eecd-d4c6-499d-a4b3-4444ad047315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfd67fde6d23497ba4bd2a672069ad30'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:30.059695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-c9a2eecd-d4c6-499d-a4b3-4444ad047315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfd67fde6d23497ba4bd2a672069ad30'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:30.060310 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-c9a2eecd-d4c6-499d-a4b3-4444ad047315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfd67fde6d23497ba4bd2a672069ad30'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:30.128420 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-c9a2eecd-d4c6-499d-a4b3-4444ad047315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfd67fde6d23497ba4bd2a672069ad30'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:30.141633 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 634/1260] 10.222.0.121 () {58 vars in 1229 bytes} [Fri Aug 26 01:21:29 2022] DELETE /identity/v3/users/dfd67fde6d23497ba4bd2a672069ad30 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:21:30.389841 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614b611-9bea-49c3-9ba8-4e88186fd793 service neutron] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:21:30.399916 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614b611-9bea-49c3-9ba8-4e88186fd793 service neutron] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:21:30.464400 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efe178-ddb3-4952-a1ce-d196d6bed530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:21:30.465025 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efe178-ddb3-4952-a1ce-d196d6bed530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:21:30.465352 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efe178-ddb3-4952-a1ce-d196d6bed530 admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:21:30.465629 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efe178-ddb3-4952-a1ce-d196d6bed530 admin admin] PATH_INFO: `/v3/projects/9ff5860548774b98b658fc8423eacf82` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:21:30.474261 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=100 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:21:30.476711 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efe178-ddb3-4952-a1ce-d196d6bed530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ff5860548774b98b658fc8423eacf82)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:21:30.478716 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efe178-ddb3-4952-a1ce-d196d6bed530 admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:21:30.605621 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-22efe178-ddb3-4952-a1ce-d196d6bed530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff5860548774b98b658fc8423eacf82', 'request_id': 'req-22efe178-ddb3-4952-a1ce-d196d6bed530'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:30.685206 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-22efe178-ddb3-4952-a1ce-d196d6bed530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff5860548774b98b658fc8423eacf82', 'request_id': 'req-22efe178-ddb3-4952-a1ce-d196d6bed530'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:30.691316 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-22efe178-ddb3-4952-a1ce-d196d6bed530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff5860548774b98b658fc8423eacf82', 'request_id': 'req-22efe178-ddb3-4952-a1ce-d196d6bed530'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:30.703546 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-22efe178-ddb3-4952-a1ce-d196d6bed530 admin admin] The token cache is being invalidate because project 9ff5860548774b98b658fc8423eacf82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 01:21:30.703840 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-22efe178-ddb3-4952-a1ce-d196d6bed530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:30.704484 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-22efe178-ddb3-4952-a1ce-d196d6bed530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:30.705980 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 627/1261] 10.222.0.121 () {58 vars in 1238 bytes} [Fri Aug 26 01:21:30 2022] DELETE /identity/v3/projects/9ff5860548774b98b658fc8423eacf82 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:21:30.710165 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2eecd-d4c6-499d-a4b3-4444ad047315 admin admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:21:30.711595 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-c9a2eecd-d4c6-499d-a4b3-4444ad047315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:21:30.725195 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2eecd-d4c6-499d-a4b3-4444ad047315 admin admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:21:30.782767 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be786e64-9160-4778-aeed-6fc5c5325235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:21:30.783430 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be786e64-9160-4778-aeed-6fc5c5325235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:21:30.783711 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be786e64-9160-4778-aeed-6fc5c5325235 admin admin] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:21:30.783984 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be786e64-9160-4778-aeed-6fc5c5325235 admin admin] PATH_INFO: `/v3/users/c5fb378caccb4baf9d663ab22aaa7751` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:21:30.797044 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be786e64-9160-4778-aeed-6fc5c5325235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5fb378caccb4baf9d663ab22aaa7751)` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:21:30.799049 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be786e64-9160-4778-aeed-6fc5c5325235 admin admin] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:21:31.005214 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-be786e64-9160-4778-aeed-6fc5c5325235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5fb378caccb4baf9d663ab22aaa7751'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:31.011481 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:21:31.021036 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-be786e64-9160-4778-aeed-6fc5c5325235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5fb378caccb4baf9d663ab22aaa7751'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:31.021753 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-be786e64-9160-4778-aeed-6fc5c5325235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5fb378caccb4baf9d663ab22aaa7751'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:31.022350 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-be786e64-9160-4778-aeed-6fc5c5325235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5fb378caccb4baf9d663ab22aaa7751'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:31.111324 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.notifications [None req-be786e64-9160-4778-aeed-6fc5c5325235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5fb378caccb4baf9d663ab22aaa7751'} {{(pid=88531) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:31.124695 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 635/1262] 10.222.0.121 () {58 vars in 1229 bytes} [Fri Aug 26 01:21:30 2022] DELETE /identity/v3/users/c5fb378caccb4baf9d663ab22aaa7751 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:21:31.390153 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efe178-ddb3-4952-a1ce-d196d6bed530 admin admin] Authenticating user token {{(pid=88530) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:21:31.390153 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.fernet_utils [None req-22efe178-ddb3-4952-a1ce-d196d6bed530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88530) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:21:31.399450 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efe178-ddb3-4952-a1ce-d196d6bed530 admin admin] Validating token access rules against request {{(pid=88530) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:21:31.457231 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bf012-f441-4b0a-8eac-335464d57e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5579ecb3986c47e1b18c2e33e293c21b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4454f1e3bf94358ad484413a3205af0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88530) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:21:31.457867 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bf012-f441-4b0a-8eac-335464d57e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:21:31.458151 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bf012-f441-4b0a-8eac-335464d57e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:21:31.458429 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bf012-f441-4b0a-8eac-335464d57e32 admin admin] PATH_INFO: `/v3/projects/061ae6e6d5d948169036bad7e228c59d` {{(pid=88530) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:21:31.468746 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bf012-f441-4b0a-8eac-335464d57e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=061ae6e6d5d948169036bad7e228c59d)` {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:21:31.470837 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bf012-f441-4b0a-8eac-335464d57e32 admin admin] RBAC: Authorization granted {{(pid=88530) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:21:31.574473 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-882bf012-f441-4b0a-8eac-335464d57e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '061ae6e6d5d948169036bad7e228c59d', 'request_id': 'req-882bf012-f441-4b0a-8eac-335464d57e32'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:31.630723 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-882bf012-f441-4b0a-8eac-335464d57e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '061ae6e6d5d948169036bad7e228c59d', 'request_id': 'req-882bf012-f441-4b0a-8eac-335464d57e32'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:31.636698 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-882bf012-f441-4b0a-8eac-335464d57e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '061ae6e6d5d948169036bad7e228c59d', 'request_id': 'req-882bf012-f441-4b0a-8eac-335464d57e32'} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:31.649411 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-882bf012-f441-4b0a-8eac-335464d57e32 admin admin] The token cache is being invalidate because project 061ae6e6d5d948169036bad7e228c59d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88530) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 01:21:31.649702 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-882bf012-f441-4b0a-8eac-335464d57e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:31.650339 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG keystone.notifications [None req-882bf012-f441-4b0a-8eac-335464d57e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88530) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 01:21:31.651838 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: [pid: 88530|app: 0|req: 628/1263] 10.222.0.121 () {58 vars in 1238 bytes} [Fri Aug 26 01:21:31 2022] DELETE /identity/v3/projects/061ae6e6d5d948169036bad7e228c59d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 01:21:41.168242 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:DELETE=3,keystone:SELECT=10,keystone:INSERT=1 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:21:41.646521 dv-osbrick-853500-2-ceph devstack@keystone.service[88530]: DEBUG dbcounter [-] [88530] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 01:25:09.101773 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be786e64-9160-4778-aeed-6fc5c5325235 admin admin] Authenticating user token {{(pid=88531) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 01:25:09.103249 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-be786e64-9160-4778-aeed-6fc5c5325235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:25:09.255061 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be786e64-9160-4778-aeed-6fc5c5325235 admin admin] Validating token access rules against request {{(pid=88531) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 01:25:09.314520 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4aa98-1440-4f3c-a15d-b452026e4697 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49070d8a078644f4a9e17deab052ba41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6af527bb8974bc6915553d99df0901e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88531) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 01:25:09.315198 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4aa98-1440-4f3c-a15d-b452026e4697 service placement] REQUEST_METHOD: `GET` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 01:25:09.315482 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4aa98-1440-4f3c-a15d-b452026e4697 service placement] SCRIPT_NAME: `/identity` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 01:25:09.315758 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4aa98-1440-4f3c-a15d-b452026e4697 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88531) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 01:25:09.317586 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.fernet_utils [None req-a1d4aa98-1440-4f3c-a15d-b452026e4697 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88531) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 01:25:09.328614 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4aa98-1440-4f3c-a15d-b452026e4697 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 01:25:09.330206 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4aa98-1440-4f3c-a15d-b452026e4697 service placement] RBAC: Authorization granted {{(pid=88531) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 01:25:09.350127 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: [pid: 88531|app: 0|req: 636/1264] 10.222.0.121 () {60 vars in 1370 bytes} [Fri Aug 26 01:25:09 2022] GET /identity/v3/auth/tokens => generated 2876 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 01:25:19.337665 dv-osbrick-853500-2-ceph devstack@keystone.service[88531]: DEBUG dbcounter [-] [88531] Writing DB stats keystone:SELECT=89 {{(pid=88531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}